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_of Regents Contract No. R5-175 “social Indicators for Educational 


reports were: 


7) 


i. is . 2 Preface ~ 


This is the fourth and final report issued in conjunction with Board 


, 


Planning -- The Skills and Knowledge of Florida Citizens." The previous 


4 
i. Aes 
"A Framework for Selecting and Utilizing Educational 
anual for Florida Citizens" - November 1, 1975 
3 


Frou Indtcators for Assessing Educational 
Achievement of Florida Citizens" - Deceyber 19, 1975 


“components of a Model for Forecasting Future 
Status of Selected Social Indicators" - March 26, 1976 


lected information from these earlier reports will be used in this final 


‘ 


(report. a .: ~ 


The assistance of a number of individyals was essential to the RONDE Eton 
of this study. Personnel in the Strategy Planning and Management Information 
System section in the office of the Associate Deputy Commissioner of the . 
State Department of Education provided distinc vet: as provided or 
haipaa us to secure needed technical assistance, They made the services of 
Dr. Jay Menddll, futurist from Florida atlantic onivedetty, beers to 
us. hte their await contribution was their openness to new ideas 
and their willingness to let the iaventhaatoxe explore new approaches: to old . 
questions. o: 

@ + . 

The following reactor panel assisted in the SasheLesE Ata of social 
,indicators: Dr. Jacob Beard, Dave Ehlert, > i aaa hii’ Dr. James | 
TeNGSENSEN Dr. Andrew ee Fred Schulte, Dr. Crane Walker. - The . 


> . 


reactor panel provided Pitaibee assistance by critiquing a  Prelapinazy 


3 ° 


ii 


3 Dr. B. 
‘ah Y Drs. Re 

* 
; ; Dr. R. 


list At Satiaabent Three different groups of educators ny laymen 


A faculty pangl provided 


. developments in their fiel 


conferences. 


to these issues: 


indicators. 


a 


Co ey 


; SESRREe suggestions which were“ sed in revising the list. 


‘ 


sistance by preparing reports of new 


¢erest based on attendance at national 


The members assisted in the identification of vapiables 


‘associated with educational achievement. A list of the issues tabing 
: é ‘ « 
-education was developed by the panel as-well as-alternative solutions 


The’ assisted in forecasting aaa values of social 


They alsa anaisted "in the: gant of sling recommendations. 


The investigator is indebted th the forteving faculty Members at the 


University of Florida for their ass 


Dr. W. 
Dr. W. 


i 


ae Ae - Instructional 


Henderson - Sociology Department 


Stripling - Counselor 
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- Hines - Foundations in Education Department 
Johnson - General Teacher Education Départment 
Kimball - Anthropology scabies : 
Kimbrough - Administration and 
Scher - Political Science Department | 
Sharp - Dean, College of Education 
Soar ~- Foundations in Education Department 
Education Department 


on ‘Oi panel: . 


‘ 


ership and Support Department 
Drummond_ - Instructional Leadership and Support Department 


upervision Department 


é t - - - 
‘The investigatdr is particularly indebted to Andres tollazo and 


Ward Thomas, ‘two doctoral students who worked as Research Assistants on 


this study. 


Each of them brought particular skills 


‘. were -indispensable to the completion of the study. 


developed an intense interest in the study itself. 


study became a team effort and the following report 


»\ 
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and knowledge that 


Further, each 


As a result, ‘the 


is the team's report. 
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Arthur J. Lewis ' 


Principal Investigator 
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ae ; ‘SECTION I 
s ¢ ‘ 


: : : 4 ‘ te 
Le p J ' tin : a 
~- 6 tt « rc 
Ne Soo a This is the report of a study undertaken with a‘grant from fhe Board © 
i aii st : i Sad . 5 
if * of Regents of the Florida State University System and the Office of the | 


bad 


: Deputy Commissioner for er Management Department ‘of la iad 


| } je The study had three sajectiwen: (1) "To identify we indicators : 
Z at 
a relating to policy concerns il the Legislature, State Board of Education, 


~ 


‘and the Commissioner of Education," (2) "To predict, the future status of 
a —_~ : 
, 2a 4 selected social indicators, using the assumption that present policies 7 


£ 


a ens - ‘will be continued" and (3) "To recommend policy changes for achiaving e. 


s sl . 


; a Trove desirable futures in oo arfas." (Contract R5-175). This report 
x, ® t ’ . 


contains information regar ing each of these objectives. As a result of . 
this study, 5ome ideas have emerged regarding procedures that could be ” 
ri ‘ r s ” 


‘ ra ad a3 ased in the formulation of educational , policy. in the State of Florida. ; C 
i, ; qo. *? Acoordinaly, this, ‘report will include “sccm ‘recomendations regarding . . - ee 
| : é ah “procedures for pokicy” formulation. : ae F one are 
i ” : : 
ae — eS, Fa The social- indicators that ‘ig identified asa pa 3 this study - fa _ * fe 
- ss are al deteas Seatio#. it of this eoeee” The. criterila that were. used 
. on , " * are descr lips and a list ‘of the social indicators welace is summarized 
‘ ‘ - = in tabular form. i ae ’ ir , . c ie .\¥ ' 
rete ‘ 


‘In order to pieaice the future Status of selected social indicators, 


» 
» 


pat: it was necessary” to ‘dgvelop a forecasting medals Thig model is described 


in Section: Ae 2 Ie of the report. . An arporeane component of the model ig a 


‘ Jist-of. variables affecting Social SALE SEO Sectioh IV includes a ~~ 
‘ _ description of the procedures used” in: jeeneitvinthe e variables ind a 

. ia: . List of the variables - “used th. ‘the Sey Sage RS : 
* A er : Fag , . : a 


oe 7 . t == is . 
= 
* x « id : 7 ° a . #5 ’ 
z rr e e ee . 
2 a9 . - F * ry & 7 5 1 
= a, a. 


“8 Section V.of the report contains forecasts of the future status 
« . 4 4 . . 
of. selected social indicators, using the assumptian that present policies k 


“4 « . 


See will be continued. A Seeer tne of the cross Ympact analysis methodology 


used in making these forecasts is included anda number of foredasts “ . 
anna on eaalea initial assumptions are presented. ; sia 2 3 
& 
¢ ° 
a In order’ to: r mmend policy, er for achieving more desirable = 
’ . 


: Putines ; selected issues that, ahi have an impact on Gants were 


identified. Alternative policy decisions regarding these issues Mere ° 


proposed: and, through the use of the cross-impact analysis,. the|effect of 


These — & - 


ar forecasts served as ue basis for making policy recommendataons. Section. VI 
8 


these, alternativés on selected social indicators wal forecast. 


of ‘the sreport ineiides a’ listing of the issues identified and the alternative 
: . ; 2% 3.) xe 
policy’ décisions. . The forecasts of consequences of using various, alternatives | 
x | nl 


. are also included in Section vi. . Seg . : 


. 


. ® » 
‘ 


Section VII includes recommendations regarding alternative policy 
decisions based on data: reported in Section VI. Some Jevandibitous recom- ‘ 


—_— e 


mendations puntvatng® goals of edupation a Florida and the process of 
formulating educational policy are also Lvauded in this final section. : | 


St 


y 
i. 


SECTION II : 7 ; 


}: Social Indicators of Educational Outcomes 
F ’ 
a ee * Ls Fs 
Rationale for the selection of social indicators 
4 ae Nt : 
, ‘The first.step in this project was to ‘aes and select social sg 


An a to ee used m the assessment of dducatidnal outcomes in Florida. 


‘ * 


For the purpose of this project, a social indicator was defined at a 
be | 3 
uantitative or r qualdtative statement that provides information cere 


he 


/-the status of Florida citizens in relation to ope or ‘more 2 of the goals” set 


forth in the’ Education Policy for the State of Florida (Department of . 
Education, 1995). 


. 


a use of social: indicators as a means of mage social conditions 
er’. rs 
and ‘trends has increased during the past’ decade. In a review of .the State 


of the art oF social reporting and the use of social indicators, 


Vieatax ; and Rienn agm) described the field as andevde veloped with few 


measures of social” welfare and progress, and with no unified body of theory. 


evaveheieds, they, pointed out threP potential gains from the use of social 


indicators: (1) the use of social indicators can result in an improvement 


~- 


in'the quality of sre cee sa ie reporting;’ (2) analytic studies of social 
change can lead beyond describing a particular trend to identifying its 


precursors and “suggesting causal variables whenever possible; and - "4 


(3) indicators are our sole possibility for developing Ay abiairy to 


‘ predict the future. 


‘The use of social indicators as a part of‘a statewide strategy ‘for 
planning and policy-making should aid decision-makers in the allocation of 


resources to education and in the Benign and woaltication of. educational 
. ‘ 
- programs. Purther, bi improving the quality, of descriptive . reporting, 


¢ =3- “ a8 


Ona . 
o ce 


a8 Pay” ..Florida are set- forth.under:the. following’ headings: basic . 


‘social indicators ald Mien + the abetity ‘pe forecast the impacts of © 


s oar) . « : 
. ’ 


futire contingencies on educationad outcohes. . - of) aphid uk F 
- 3. iy > : . ¢ ‘ @ a 4 
‘, ee a Four . assumptions provided guidelines for the seredtion of social 


oe “| av 1 


apebinkors., These assumptions, deal ‘with the purpose of education’, goals 


é “ 
a) ate EJ a 


me, of, education, yooys af adiatiee: afiad target ‘population for accede 


, ", je 


Bs Gn, a he ce Purpose of reduication'= The Florida’ Constitution’ spécifies that. 
pF 8 ‘ .the state shall provide education’ ‘programs "that the. needs of 


*. , Social indicators, therefore, were selected to, provide, in for- 


r mee , i 5 "athe {people inay . require." {Department of Education, 1975, p. 1 
i : mation regarding the extent''to which education is, fulfilling a “ 
e 


is Sada C2 ag role in meeting: the manda: ‘of. the BROpIE a, ¢>% 
a Hin = F’ , 
et ai = ame” Goals of Education - “The abate’ of education for the State of 8 


skills, general education, vocational competencies, ‘advanced™ 

r knowledge and skills, research ang deve lop @t, recreation 

~ “+ "and ldisure skills. (Department of ,Educafion 1975) These . ‘ 
ee se ‘ a defined the areas in which social. indicators, were perapeen: 


a = ia Locus of education - A bepartwent of Education publicatio 4 
a ‘ .: indicates’ that education takes place xin a nomber of, eee res 7 * 
7“ the home, thé tommunity, the church, and ether institutions, 

ni z ‘as, well as schools. (Department of. Education, 1975) "Accordingly , 

SN te social indicators that were selected, teflect what has beén : sid ; 
Sg ; achieved through a combination ‘of influences., F eee 2 ao 
< a za ‘ : = 
4. Target population for education’ - “in faddaaglon Pali ser the | -° 
.*. . State of Florida,. public education ‘is charged with: the “responsi- . . 
bility for providing learning dpportunities. for persgns of. all * 
oe 3 sages from early. childhood to late adylthoods . (Department of 
- . Education, 1975) Therefore, ‘the -social indicators ‘that were 

“4 , selected provide information on “the /level of competence of 

. citizens of all’ ao : 


4 


; - : a & P : . . . ; 

Z Three primary types of measures were considered as a hasis for social 
indicators; (1) ‘measures a the level’ of knowledge" and skilts; (3 measures 
of the ability to aan Knowledge and, skills; (3) .measures of the Sehidsglin . 

Re knowledge and skills. hen apitopiiate, “measures. associated with attitudes 


toward education were considered. The. first two types of measures are 


« ‘ 


relatively direct indicators, of performance and. abe’ edntiine to educators. 
t+. = 
These measures are referred to in this report as is pee foteanee measures; for 


example, results on the Florida Eighth Grade Test. The use of measures of 


* a tf 


. 


- 

‘4 

conditions in society as a means of assessing the utilization of knowledge 
a . 2 . 


and skills is a new idea that has not been tryed in practice’ These 
. 7 ° . ] 
. Measures are relatively. indirect and are refefred to in this report as ‘ 
» ’ ; 
utibization measures. An illustration of a utilization meanice would be 


La 


the Ne of the labor force that'is unskilled. The difficulties and 


limitations associated with the selection and uge of social: indicators are - 
7 ; discussed in the second technical report “of this project. (Collazo, Lewis and 
‘ r —.. 
“Thomas, 1975) : , 
. . : & 
Social indicators recommended : *s 4, 
~~ a 


* 


The seven goals listed in the Education Policy for the State of 


Florida (Department of Education, 1975) served as a basis for categorizing 
social ,indicators. Th goals as stated were too general to be used in 


selecting outcome measures. Accordingly, it was a inacaies to’ describe 


< 


how an individual would perform if he or she had achieved the goal. ‘The 


procedure followed in'elaborating these performance descriptions, together 


. 


; e , 
with the descriptions, is to be found in the second tecknical report. 


‘ of this project. : (Collazo, Lewis and Thomas, 1975) Once the seven goals 


were defined in operational termg, it was possible to select measures of | 


. performance and attitudes.” The first step was to consider the posible 


= - 


use of existing statewide programs for collecting data.to measure 


measures were examined as poseiiis sources of data. 


After reviewing the literature on published tests and the statewide 
e . = a ; 
. testing program, it was decided to recommend eriterion-referénced measures 


rather than norm-referenced measures. The former would indicate the per* 
7 . ’ 
centage of individuals who have met siege level of competence in terms 


4 Of certain objectives. On the other hand, norm-referenced measures would 


- 


indicate only the positions of individuays in eldcion to is performance 
oN =~ » baal 


e -5-, i q . 


- ae | * 


1 his | ; as 


/ : : vay re 
edutational outcomes. Later, additional performagce and attitude 


of ,others*(norm group) on the same measure. Furthermore, these measures 
«, ; 


4 
have their norms changed periodically, thus obviating their use'as time : 


' 


series data. Criterion referenced measures, on the other hand, could : ' 
=” y ¥ » . 


provide adequate, time series data seaaedbng the level of achievement of 


x 


' Florida ¢ftizens and consequently would provide better information for 
a . » ; r Py 


ss z 
making policy decisions. 


R variety of sources were consulted to identify appropriate utilization 


measures. Some social indicators were selected from an assessment of- 


educational needs conducted in Florida.’ (Department of Education, 1970) 


‘ ‘a ah ae ; | : 
Others were selected from various published sources of sotial indicators. 


, a: ‘ : A 
A panel OF pxperts was asked to .réact, to a proposed list of social indi- 
: > us : “ ~ 
cators and to suggest others. (See p.ii for list of members of reactor panel) 
yW is ° a ; : 
A large number of possible social indicators were identified in this 


z a 
process. The list was reduced to its present length by uSing the following 


criteria: 


1. The quality“and appropriateness of the data-collecting procedure 
2. The caxe of collecting the information: 
3. The cost, of collecting the’ information 


; 4. The probability of public acceptance of the significance of 


the social itdicator : 7 
int 
5.- The importance of the goal associated with the social indicator. : 
The s@gial indicators recommended for use are listed in Tables 1 and-2. 
r) 
Table 1 incluries performance measures ‘and attitude measures. Some of 
% the cells in this table are empty because no suitable indicator was F 7 
: < z cae 
identified. Table 2 includes utilization measures and indicates the 
* source of the data. 
- = a 
r 
| 
« 4 e , 
a -6- ’ > 
¥.Se . . z ¢ 
’ . P 


«> 


- 


13 


; General Education 


3 4 ae ° +. ~ 
ee ; oo oe : Tablel . * 4 


Recommended Performance Measures and Attitude Measures 


° a : 


. 


‘ National Assessment of Educational Progress 
tests (NAEP) in reading, writing and 
mathematics: ' 
7 OR 

State Assessment Program and Adult 
Proficiency Level '(APL) tests 


- 


Basic Skills — 


Human Relations 


SS ae ee ee ey a 
citizenship 5. ena AAA aI a Pee 
? Conduct 
“Mental and Physical , _ ea 
; Health * : 


Aesthetic Scientific, 
“anf Culturals °~ 


wore mes T 
music and art areas) . / ; NAEP 
Economic Understanding — 


Vacational Competencies NAEP 
: AND 


General Aptitude Test Batte 3 NAEP - 


4 
« 


. Number“@assing proféssional licensing 
Professional Competencies examinations. Passing rate on professional 
exams of individuals educated in Florida — 


Advanced Knowledge and Tests that are administered .t6 those who are 
Skills : intending to continue graduate studies: 
: GRE, LSAT, MCAT, DAT ' ‘ ‘ P 


Recreation and‘Leisure. 4 : 
Skills é 


4 


$3 


-e@g- - 


Human Relations 


= 


. 


, Table 2 


‘ Recommended Utilization Measures 
‘ 


© om 


Pail 


d Ol) Med C 
Number of illiterates a Ni peaple 
é ¥ ‘ . 


Percentage of population enrolled ih 
school by age and place of residence 
Percentage of selective service draf- 


U.S. Department of Commerce, 
Bureau of the Census, Statis- 
tical Abstract of the U.S. ; 
(S.A.U.S.) ’ 


S..A3U.S8. . 


tees-and volunteers failing pre-induction 
and induction mental tests a 


Percentage,of population completing 


U.S. Department of Commerce, 


sélected school grades =: ‘Bureau of Census, General, 
; : cba ET 


* 


Non promotion in Florida Public 4 


Schools by grade level 
Number of newspaper subscriptions 
in Florida/capita , 


Social and Economic Charac- 
teristics, PC (1) - Cc Li 


Florida (GSEC) 
Research Reports of Florida 


ai Départment of Education (RRDOE) 


Standard Rate and Data Service 
: Number of divorces/1000 population Florida Statistical Abstract 
u (FSA) 


Rate of divorces in relation to 
marriages : 


Referrals to juvenile courts by parents 
or guardians/1000 population 


Relationship between victim and 
offender for certain violent crimes 


. 
| 


Department of Health and Reha- 
bilitative Services, Division. 
of Youth Services, Florida Ju- 
venile Court Statistics (FJCS 
Executive office of the Presi- 
dent: Office of Management 

and Budget, Social Indicators, 
1973 : ‘ 


-qg- 


17 


Gaals of Education 


Citizenship 


Moral and 
Ethical Conduct 


‘ 


Mental and 
Physical Health 


Table 2 (cont.) F 


: ; od : : x I 
_t Recommended Utilizatiog Meayures i . " 


° 


DRata- Sources 


State of Florida, Office of 
of State. (OSS)" 


Utilization Measures . 

Percentage of persons of ia age 

registered to vote 

Percentage of registered voters who cast 

ballots in selected elections 

Percentage of-persons in political 
prties 


to juvenile courts 
Percentage increase-decrease in juvenile 
delinquency referrals by sex and race 
Illegitimate births as a percent of 
live births. = 


Department of Health and Reha~ 
bilitative Services, Division 
of Health, Florida Vital 


: 


’ 


Number of cases of fraud broughtbefore 
courts in the state *, 
Number of persons in correctional 
institutions/1000 population 


Number of infant deaths/1000 live births Pe URe Ge ee ee eS al 


Number of patients in mental hospitals/ 
1000 population 
Number of persons in nursing and per- 
sonal care homes/1000 population: 
Days absent from work on account .of Department of Health and Reha- 
alcoholism bilitative Services, Bureau 
. of Alcoholic Réhabilitation 


‘18 


4 
ad ) ‘ . : 
fable 2 (cont.) : ! 
: ‘ . a “ee : ‘4 : 
Recommended Utilization Measures 
Goals of Education : eee on Rennes Measures 
Fate of. venereal | Rate of. venereal disease: ————siyssdig ee 


Mental and vse e of Florida, Department 
Physical lth sex and race aw Enforcement 
_ (cont. ), Rate of admissions to State Mental ieanae ; 
Hospitals “BSA « 
Contributors to education television/ 
1000 population : Stations 
’ Aesthetic, Scienti- Per capita support of public television 


fic and 
Cultural Knowledge 


Per capita support os music and art See Department of State 
«Division of Cultural Affairs 
(DCA) 


DCA 


theater companies companies, etc. 


Number of local SpAbtaEE of environ- : 

mental groups and number of members Organizations 

in such groups es : : 
Rank held by environmental concerns in . Ss ars 
opinion surveys of the importance of Louis Harris Poll - | 
public issues d 

; 

Number of children receiving Aid to 

Dependent Children bilitative Services (DHRS) 

Birth rate per 100,000 women of child a 

bearing age 
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Goals of Education Utilization Measures : 


ee ed 

hold ; y p ‘ 
lation - ~ 5 P ; 
and’ not in labor| force - ; RRDOE : ; . las” The 
training and place of résidence FSA ~ a3 5 ; 
Dloyed or engaged in further education FSA and RRDOE . ; 
Percentage of labor force unskilled U.S. Dept. of Commerce, Bureau 

5 : - of Census. Census of ao 

: Population . : re 

Professional Number graduating from professional . 
Competencies schools by race, sex and program Board of Regents 
‘| Number of degrees granted by Florida 


Institutions of higher learning by 
specialization 


grant monies to Florida residents ( 


Vocational FP. 
Competencies ye 


Advanced Knowledge ° 
and Skills 


*. 


Percent of the State University System 


Research and 
Deve lopment 


eT 
Budget spent on research and development | Board of Regents 
¥ 


Total dollar amount of Federal grants ; ’ ‘ 

for researql ‘and development in the Ag 

state Board of Regents : 
Amount spent by private industry with- 
in the state for research and develop- : 3 

. ment . Board of Regents. 


The same recommended for the Aesthetic, 
Scientific and Cultural goal | 


Recreation and | 
Leisure Skills 


Personnel in the oe of ahratroy Planning ‘and Beasaaen’ Informatior¥, 


a7 System, ‘Department of ‘tianabiue. specified five indicators to be’ used by . 
\ « *. ' . ; a 
‘this project in.making its forecasts: + : oe : 


t. Percentage of armed forces inductees “ho, peat bia mental test 
upon induction - 


2. Eighth grade test xesults . ‘ ‘ s 


J “ ; i . 


3. NAEP reading test results for 13 year-olds s , 
. 4. Per capita consumption of printed mater{fal 
i 5. Percentage of labor force unskilled. 
F The fourth indicator was modified, with Sppssvnr from the Department of ae 


@, 5 


Education, to: number of newspaper ‘subscriptions per capita. 
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SECTION IIt 


7 "forecasting Model for Soci¥ Indicators 

ne one responsibility of the investigators was "to predict the future 
status of selected social indicators." (Contract R5-175) Futurists er 
a distinction between the caiie: "predict and Yorecast." (Joseph, 1974, 
Bell, 1975) To predict is to foretell the occurrence. of events. To 
forecast, on the other hand, is £6 describe Srenng and probabilities. 
Recuraté' predictions require the foreknowledge of future events which 
was not available to i researchers. But even forecasting is difficult, 
beeauie vedbabhsetie aiakanaae are dependent geite aban arias The 
further ints the future the facncane Retin. the greater the chance that 


. 


unforeseen contingencies will invalidate or at least modify these 
aaemeeieen, For example, tonoveow's weather can a ibaaane ak more 
certainty than next week's. Because of the many factors affecting 
education and the eheirabRl ba legabun of.their occurrence, this stydy 


will present forecasts rather than predictions. 
In order to forecast future trends of social indicators it was first 
necessary to identify the intervening variables phat will affect these 
indicators and to forecast future eisai of these variables. Since these 
intervening variables are independent in regard éo. wiicationad out comes 
but dependent in relation to forces within society, thay Ghiacdeatanwtad 
as influencing variables and consist of two types: in-school and out-of- 
school. The use of these variables in faveckabing social indicators is 
analogous to the weather forecaster sitimetng information on movements of 
air including the location of cold fronts, determining if the barometric 
‘pressure is rising or falling, securing readings on the humidity, etc., 


as a basis for, making a weather forecast. 
-10-, 
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o 


An illustration of the effect of out-of-school influencing ’ “ 


variable is provided by infarmation in a recently released eas teiah: 
; America's Children 1976: “Des Seti: about one in six shitdves in 
America lived in families whose income was below the official poverty — 
level.. . . This compares, with about one in seve children in 1970." 


x ; 
(Associated Press, 19%) Research shows that socio-economic status of | 


. ' 
children is associated with their achievement as measured by standardized 

test scores. Had the increase in the percentage of hisaews living in 

poverty been foreseen in 1970, a decline in standardized test scores 

“could have been forecast. Looking ahead, if’ the percentage of children 

living in poverty continues to increase, the,scores on aehi@esanany tests 

will continue to decline, assuming that. other variables remaif, constant 


and unless some countervailing actions are taken. 


5 . 


Once the various influencing variables affecting the indicators were 


identified it was necessary to estimate the probable influence of each 
a ) = 


variable on each indicator. However, these variables also influence 
each: other and through ‘this interaction have further influence on social 
“indicators of educational outcomes. For example, the socio-economic 


status of parents influences their level of aspiration for academic 


s 


. # 
achievement of their children and the self-concepts of their children. 


e 


Thgse variables in turn influence educational outcomes. 


= ¥ , 
If, for example ,3ten variaMles wege to be considered in forecasting 


trends in an indfditor it would be necessary, to consider the interaction 
between ‘and‘among each of the ten variables and, the indicator. Since this 
4 
would davoive 121 dyadic interactions, it would’be extremely difficult, 
y 
if not impossible, for a forecaster to weigh all the interactions. As a 
4 


result of such complexity, Kane (1972) concluded: " .. . decisions are 


\ 
usually made in truncated spaces by sharply reducing the variables that ” 


~-] 1l- % 
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will be considered." The cross-impact analysis technique enables a 
forecaster to minimize this difficulty. 

To use the cross-impact analysis technique, it is necessary to 
construct a matrix. This matrix contains estimations of the probabilities 


that events will occur. In order to use cross-impact analysis in this 


study, the variables and the social indicators were treated as events. . 


. ‘ 


For example, to treat the variable, students" sbissconcente, as. an event, 
one could state that, "the sel f-concépts - students will decline by 

a 3 
1981." An indicator stated as an event would be, "eighth grade test 
results will increase by 1981." It was then possible to estimate the 
impact that the gccurrence of one of these events would have on-the 
probability that another event would occur. By assigning velivep that 
deat eae only two events at a time, it was possible to construct a matrix 


containing a number of influencing variables and estimates of their effect 


on each other and on the indicators. Through a computer program it was 


” 


then possible \to forecast the prohabitity that the value of a social 
indicator will ihcrease over a given period of time. A detailed discussion 
regarding construction and use of cross-impact matrices is presented ‘in 
Section V. : 

A more sophisticated approach to forecasting is represented by trend- 


ae 
impact, analysis. Whereas cross-impact analysis can be used to forecast 


the probability that an indicator will increase or decrease, the trend- 


“ impact analysis can forecast the range of probable future values for an 


indicator. The use of trend-impact analysis requires a computer program 
: a 


which was not available ina language compatible to the computers 
accessible to the researchers. icant dines analysis, building on the 
principle of cross-impact analysis,- forecasts future trends by extrapo- 
lating time series data. Unfortunately, such data are not readily 


me 
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available in education because of the common use of norm referenced tests. 


This obviates their use in a time series. Furthermore, school districts 


r 


a = 


J and the State“Department of Education frequently change: the criterion 


\ é 
\ a . 4 


ee ee hy ; 
7 +e ‘ 
eons tests they use. Statewide use of the NAEP tests over a period 


of years could generate the time series data base required for trend- 


- 2 \ P ry 
impact analysjs. 
. we a we 


\ . . 
Cross-impact analysis was used in two ways in this project. First, 


. 


10, variables affecting educational outcomes were considered and future. 
digebbions of change on five social indicators were forecast. This appli 
cation of the cross-impact analyeis assumed that present trends would 
re The results of this application aré reported in Section V. 

. The second use of cross-impact analysis was based on the assumption 


that variables and indicators would be influenced by possible future 


events. The researchers with the assistance of the faculty panel identified 


. o 


‘issues that could impinge on social indicators. (See page iii for a list 


of members of the faculty panel) Alternative decisions ‘in relation to 


these issues. were then proposed. These alternatives were used in cross- 


impact matrices in order to forecast their impact on indicators. A dis- 
cussion of the issues and alternative decisions feseallean with the results 
of using the aronactabade program are contained in Section VI. 

Figure l is a schematic représentation of the forecasting wot used 
in this project. It is important -to ‘eeneunhan the limitations inherent 
in this model / When one considers how often the weatherman fails to make 
the éaninde forecast of tomorrow's weather, in spite of excellent sources 
of data, the hazards of forecasting.values of social indicators five years 


hence become apparent. The forecasting methodology used in this project 


attempts to Mia making decisions in truncated spaces. .At the same time 
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Identify social 
indicators to 

measure educa- 
tional outcomes . 


q 
Figure l 


Forecasting Model for Social Indicators 


Identify influencing 
variables affecting 
educational outcomes 


| | ' 


Const ruct 
cross-impact 
matrices ~ 


Modi fy@¢ross-impact 
matrices based on 
intexgvention of © 
alternative policy 
decisions on issues 


Forecast future 
directions of social 
indicators assuming 
present conditions 
continue 


a 


Prepare 
recommendations 


Identify future 
issues which may 
affect the 
indicators 


Identify 
alternative decisions 
regarding issues 


Forecast future 
directions of social 
indicaters assuming 
intervention of 

selected policiles 
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it is crucial to keep in mind that the entire procedure is based a a 
‘ series of assumptions regarding probabilities that events will occur 
and regarding the probable. impact of one event on another., Given these 
F limitations, the results should. be. used to generate an agenda for actions 
to be taken to improve future educational outcomes rather than to be 
F viewed as ‘a fait accompli. To date, man can do little to change tomorrow's 


weather. He can, however, influence the quality of education in our 


society. i 


SECTION IV 


Variables That Affect Educational Outcomes * 
Review of research literature ' ei : 
. The purpose of this section is to present the Beaty findings of the 
_ review of research literature on variables that affect educational outcomes. 
This review is not an exhaustive one but it includes the basic studies done 
in this broad aves In order to attain the objective, primary sources 
were seed as well as vrevious reviews. 

Fducational silent are generally divided into two categories: 
cognitive and noncognitive. The former includes intellectual processes 
while the latter includes motivation, attitudes, social sKills, sel f-con- 
cept, learning styles, etc. Although educators recognize Oe teccrkane 
of hoth kinds of outcomes , most, of the research done concentrates on.the 
variables that affect cognitive Gineoied, and little research ,has been 
directed toward discovering variables associated with noncognitive ones. 
Furthermore, most of the studies have considered cognitive achievement as 
meaniea by standardized achievement tests. Consequentlys, the available 
research is directed toward discovering variables associated with cognitive 
achievefbent as measured by standardized achievement tests. 

Basic approaches. Averch, et al. (1972) classified the research done 
in this area into five different nein, (1) the input-output approach; elMF 


(2) the process approach; (3) the organizational-approach; (4) the evaluation 


approach; (5) the experiential approach. - 


- 


The input-output approach views the school as a channel through which 


resources (inputs) flow to the students and from which some output flows, 


"This section was incorpérated from technical report No. 3. 
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4 
usually defined in terms of cognitive achievement as measured 


standardized 
achievement tests. The researcher tries to answer the question: To what 
extent if the variability in educational entesiee due to variatiions in 
resource levels? He collects a body of data ata given point jn time, 
usually applies multiple regression analysis and tries to make indetanoua 

e Equality 
of Educational Opportunity survey by Coleman, etal. (1966) is/ an example 


Si about the effects of the inputs on the educational outcomes. 


of this kind of research. 
In the process approach what matters are the processes by which the 


‘ 


resources are. applied to the students and the. responses of the students 


s 


sth 7 
.y 


to those processes. The main purpose-of this approach is to expand the 
knowledge of the nature of ‘educational processes and to determine the 
factors affecting educational outcomes. The researcher conducts small- 


* o 


scale experiments, either in the laboratory or in the classroom. a 
The organizational approach assumes that improvement in the functioning 
of educational organizations, such as schools, results in better educational 
outcomes. The-school is seen as having to adapt to the needs of an ever 
changing body of students and to changes in outside forces, such as social 
demands .. The. inputs are cia rules, procedures, ‘incentives and so forth 
seg up within the system. The purpose of this approach is to understand 
the behavior of the whole system and to describe the structure of the school 
and how and what happens to the people in it. Research here primarily uses 
. the case-study method. Averch, et al. (1972) pointed out that this sopetact 
4 is relatively underdeveloped as compared with the others. i yt ; 


i 


Studies within the evaluation approach consist of ex post facto analyses 


of comprehensive educational interventions in existing ‘schools. Researchers 
that use this approach look for the effects of a general intervention upon 


educational outcomes. No attempt is made to determine wky or how an intervention 
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«* 

“er, 
affects outcomes. The surveys of compensatory education illustrate this 
I . 


! 
, approach. ‘ 


| d 
| Those who use the experiential approach are concerned with what happens 


| 
to students in schools as an end in itself. As Averch, et al. (1972, p. 11) 
said "the primary emphas}s is on the effects of school experiences on 

‘j} student's self-concepts and on their relation to other people and to social 

n institutions." The research within this approach is frequently provided by 
particibant observers in terms of descriptions of their experiences. The 

eats by Silberman (1970) , Holt (1967, 1970), and Illi (1971) illustrate 
this approach. | 

The literature reviewed for the purpose of this section is representative 

of all these approaches. For practical purposes, it will be peace in 
integrated form and no reference will be made to the approach used by specific 


é ? \ 
studies, : # 


Family” background. The: socio-economic characteristics of the student's 
family are gtronqly related to his aeadewie achievement (Armor 1972; 
Averch, et al. 1972; Baocock 1966; Coleman, et al. 1966; Sark 19°72) 
Mayeske and Benton 1975; Mayeske, et al. 1972, 1973; McDill, et al. 1967; 
Summers and Wolfe 1975). ‘The results are consistent across studies. The 
higher the socio-economic status of the student's family, the higher his 
academic achievement and educational aspirations. This relationship seems 
to hold no matter what eacuranent of socio-economic status is used. The 
re eer eee however, are the education and occupation of the head of 
household. 

Averch, et al. (1972) indicated that a student's academic achievement 
can be predicted approximately 15 percent more accurately if his family's 


socio-economic status is known. The imoortance of this factor was described 


by Coleman, et al. (1966, pp. 21-22) as follows: 
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The ‘first finding is that the schools are remarkably similar 

in the way they relate to the achievement of their pupils 

when the socioreconomic background of the students is taken ' ‘ 

into account. It is known that socio-economic factors bear 

a strong relation to academic achievement. When these 

fattors are statistically controlled, however, it appears 

that differences between schools account for only a small 

fraction of differences in ‘pupil achievement. 

The hypothesis that the role of family background factors in achievement 
exceeds that of school factors has also been supported by Armor (1972); é 
Jenks (1972); Mayeske, et al. (1975); Smith (1972). 

There is little evidence to support the assumption that the structure 
of the family (the size of the family, number of parents in the home, etc.) 4 
exercises a strong independent influence on the student's achievement. 
After an extensive and complex analysis of the data of the Equality of 
Educational Opport unity survey carried out by the U.S. Office of Education, 
Mayeske and Benton (1975, p. 125) concluded that: 

_For most students, the relationship of family structure with 
~ achievement tends to be moderate or low. Most of this 
; relationship can be accounted for by variation in socio- 

economic status: the lower it is, the less likely the family 

is to remain intact. 

Although it is generally accepted that family expectations, attitudes 
and aspirations regarding life and education have a strong influence upon 
the student's achievement, this has not been well substantiated by empirical 
evidence. Little has been done in clarifying the nature, and strength of © 
this relationship. The strongest support comes from the work by eal, 
et al. (1972). They studied a series of variables in what they referred 
to as "Family Process Set" and discovered that the ones with the strongest 
relationship with achievement were educational plans and desires and attitudes 
‘toward life. They also found that both relationships persisted even after 
all the other variables had been taken into account. Mayeske, et al. 


concluded that their study demonstrated that family background plays an 
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important role in the student's achievement, not only through seetad: and 
economic well-being, but through the values its members hold regarding 
education and the activities that parents or caretakers engage in with 
their children to make these values operational. 


my 


Sex. One may expect divterentes in achievement between sexes if 
cultural influences such as role expectations, social norms and Shas sex- 
related personality characteristics are considered. Khan (1976). presented 
evidence which indicated that correlations between predictors and achieve- 
ment for females are higher than similar correlations for males. Simons 
and Bibb (1974) found significant sex di ttacnncea in underachievement : 
that ie there ‘were more male underachievers than females. Summers and 

“Wolfe (1975) pointed out that a student's sex is related to his achievement 
at all school levels. In elementary school, they found that ‘females do 
better than males. In junior high school, only low ability males do more . 
poorly than low ability females. In senior high school ” nan of average 
ability or'less. do better than females with equivalent sivten. On the. 
other hand, in their extensive analysis, Mayeske and Benton (1975) found 
that sex is not a major source of differences among studente in achilevanant 
and motivation. Thus there does not seem to be a clear relationship 


A 


between sex and achievement. 3 s 


Racial-ethnic group. The existence of ethnic differences in educational 
achievement has been pointed out by many studies (Armor, 1972; Coleman, et al. 
1966; Boocock, 1966; Pollard, 1973). Negro students and other minority 
groups are lower in academic achievement than white students. This relation- 
ship seems strong when certain other euelatiwe: are not controlled or“taken 


into account. Armor (1972) and Mayeske, et al. "(1973) indicated that most 


of these differences can be explained in terms of family background. 


¥ 
« 
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Mayeske, et al. (1973, p. 147) found that when “Family background, aree of 


residence and various aspects of the school attended were taken into 
account, the degree of variations in achievement that could be attributed 
to racial-ethnic group membership dropped to 1 percent or less." 

On the other hand, Jensen (1969) provided evidence that supports the 
importance of racial membership in the student's achievement. He indicated 
that there are innate a Tcekences in ability between different racial 
groups. His findings and his aHeerences Are a matter of much controversy SQ 
and more research is needed before any valid conclusion can be reached. ‘ 

Thus it seems that we cannot make inferences about the independent 
efféct of racial-ethnic group membership in sc ara and motivation by 
our present state of knowledge. = 

Region and type of community. There are some inditations that the 
region and the type of community in which a student lives affects his 
educational outcomes. The National Assessment of Educational Progress 
indiéates differences in student's academic achievement and attitudes 
between different regions in the United States (Johnson, 1975)... 
Boocock (1966) described a study done by Rogeff in which it was found 
that there was a relationship between the structure of the community and 
the educational aspirations and scores on a scholastic aptitude test of 
a group of students. She also pointed out’ that the Project Talent data 
suggest that different types of communities may ‘foster or emphasize 
different types of achievement by able students. 

On the contrary, Mayeske and Benton (1975) found that the region of a 
the United States in which a student resides has little effect on his level 
of achievement or notdvablon: Regional membership was found to account 


for only about 5 percent of the total student variations in academic 


achievement. They also concluded that the observed regional, differences 
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in academic achievement can be explained.in. terms of. the regional averages — 


in socio-economic status, motivation and type of school attended, either 
singly or in any combinations- , . : ocr ie , 
School resources and facilities. Most studies sehivasis agree ‘that 
school resources and facilities account for relatively little variation 
in pupil achievement (Armor 1972; Averch, et al. 1972; Coleman, et al. - 
1966; Jencks 1972; Lyle 1967; Mayeske, et al. 1972, 1975; McDill, et al. 1967). 
ois studies refute the notion that per pupil expenditures are the key 
detexnivant of pupil achievement. The lack of evidence of the influence of 


school resources and facilities on the student's achievement was indicated 


by Averch, et al. (1972, p. 148) as follows: ; 


When we examine the ‘veguliee across studies we find that school 
resources are not consistently important. The particular ' 
resources that seem to be. significant in one study do not prove 

, to be significant in other studies that include the same resources 
in the analysis. 


ry 


Coleman, ee wl, tag6e) pointed out mhak variations in facilities and z 
curricula of schools usually account for little variation in student 
achievement; however, they aacaunt for more variation of student achieve- 
ment within ainaetty arenas than within the majority white group. 
One of the variables that has been considered in some of the studies - 
is class size. Reviewing the ithevabuve of the relationship between 
class size, and achievement, Boocock (1966) concluded that research in this * 


area is rather inconclusive. McDill, et al. (1967) found a low correlation: 
between this variable and the academic achievement of the students. .On ‘ 
the other hand, Summers and Wolfe (1975) found a relationship between class 
size and achievement.’ They found that classes of 27 or fewer were helpful 


for low-ability se ya students and that classes of 34 or more appeared 


detrimental to everyone. 


- a 


1 
-22« : as 


Pa 


Another variable that has been considered by some researchers is 
a 


school size. In this case, as well as in class size, the results across 
studies are inconsistent. .Boocock (1966) presented some studies whieh 

reveal contradictory findings. One step toward a better understanding of ’ 
the eelakignanis between school size and student ‘achievement was carried 

out by Summers and Wolfe (1975). Analyzing this relationship by different: 


, 


groups of students, they found that the effect of the size of the school f 


‘varies with the kind of students. Smaller schools apparently were associated 


"° 


with higher achievement particularly: for elementary and senior high students. 
Black and elementary school wincenee and low-ability high school students 
seemed to benefit most from smaller schools. Th type of analysis they 
followed in clarifying this relationship as well as others seems fruitful, 
although their findings are far from being conclusive. 

Teacher characteristics. In their extensive review of literature, 


= . Q 
Averch, et al.‘ (1972) found that although there is considerable research . 
conducted on teacher characteristics and their influence on student per- 
formance, little can be concluded from them. They indicated that one of ' 


we 


the limitations in these studies is that student achievement has rarely 
; 2 : 7 


been used as a criterion. Other criteri*, such as supervisor's or fellow- 
teacher's ratings, are not appropriate since these ratings do not correlate 
with studant achinvenat 

. Of the teacher characteristics studied, there does seam to be evidence 
that the hedeinets training and experience are related to student achieve- ‘ 
ment (Boocock, 1966; eA Seae. et al. 1966; Lyle 1967; Mayeske, et al. 1972; 
Summers and Wolfe 1975). Coleman, et al. (1966) found that the quality 
of teachers shows a ‘seieens uacntiassnis to pupil achievement. They also 
found that this relationship is progressively greater in higher grades,” 


indicating a cumulative effect of teacher qualities in the. student's 
-23- < , 
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academic achievement. The teacher quality appeared to be more important to 


minority than to majority students. hong the teacher characteristics 
measured in the survey, .those that had the highest relationship to student 
achievement were, first, the teacher's score on the verbal skills test and 
then his educational -background. ) 

In their reanalysis of the data used by Coleman, hs iis Mayeske, 


4 


et al. (1972) found that teacher attributes highly related to the school 
outcomes wie those associated with the teacher's experiences in : 
racially inbatances educational settings. bieck teachers attended pre- 
dominant fy nonzwhite educational institutions. The result is a less pene : 
presavablon than that received.in predominantly white institutions. 

In the study done in Philadelphia public schools, Summers and Wolfe 
(1975) found that students in elementary school did better with teachers * 
from higher rated colleges and universities, especially those students in-° 
the low income group. They also fora nat the length of experience of the 
teacher had & different impact on high and low-achieving students. At all 


school levels, high achievers were found to do best with more experienced 


» 
“= 


teachers. Surprisingly, low achievers in elementary school were found to 
do best with relatively inexperienced teachers. Education of the teacher 
: ea Z . 


e 


beyond the bachelor's degree was not related to better student achievement. 
Teacher-student interaction. wie avate of knowledge about teacher- 
student interaction, and its influence on student's educational outcotes 
was described by Boocock (1966, p. 8) as follows: “thare does not seem to 
be any one type of teacher or teacher-student relationship that is best for 
all kinds of eres and all kinds of students." A similar conclusion was 
presented by iid, et al. .(1972) who found studies that indicated that 
some teachers do better heh certain types of students and that there is no 


single best or right way to teach. 
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se % review of literature : Sane er found a relationship between 
teacher indirectness labgaant freedom) and criticism and student pausattanns 
outcomes. This relationship is not linear and is rather in the form of i a 
an inverted "U". 


Up to some point, increasing indirectness leads to greater subject 

matter growth and more favorable attitudes, but beyond that point, 

further increases in teacher indirectness lead to decreased subject 
matter growth and less favorable attitudes. (p. 187) 


The appearance of an inverted num in the relationship between teacher 
control and student growth suggests the possibility that more than one 
process or mechanism is involved in this relationship. This phenomenon 
should be studied more carefully by educational researchers. 

Soar (1972) also found that the research in this area suggests sthat 
the kind of teacher behavior is acnsetatea with the level of complexity ‘of 
the adtileveiaht: Gain in simple concrete kinds of achievement, such as 
Memory of facts, is positively related to etonety supervised classroom 
activity; whereas, gain in more complex abstract achievement,: such as 
development of concepts and principles and creative work, is positively. 


» 


associated with greater amounts of student freedom. 

Rosenthal and Jacobson (1968) pointed out re ieortanos of teacher 
expectations on student educational outcomes. ‘However, their research has 
been critized in its methodological aspects and more recent studies have | 
failed to replicate their findings. Dusek and Connell (1973) found as a 4 
result of their study that neither biasing statements nor false test scores 
given to teachers affect children's test scores. However, they point out 
that the findings suggest- that teachers' own expectations of student's 
apie are related to the way teachers treat different groups of 
students. This may influence student's self-concept and classroom performance. 

| 4 
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Averch, et al. (1972) concluded that studies suggest that teacher 


expectations probably influence teacher and student behavior and may 
influeneé student achievement, but that more patwaids is needed to determine 
the strength and nature of this TALASLONSNSE 

are characteristics. The literature about the influence of 
the student-body (peer group) on the academic performance of individual 
members presents inconsistent findings. In the Equality of pdusauional 
Opportunity survey, Coleman, et al. (1966) concluded that a student's 
achievement is strongly related to the educational backgrounds and aspirations 7 


1 
, of other students’ in the school. Children from a given family background will 


achieve at different davels when put in schools with different social 
composition. In their reanalysis of Coleman's data, Mayeske, et al. 
(1973) corroborated these conclusions. They also found that although 
there is considerable saxeetntion between the achievement-motivational i 
composition and the social composition of the student-body, the. former hag 
the greater influence. Consistent with these findings, McDill, et al. 
(1967) found that in those schools in which academic competition, intel- 
lectualism and subject-matter competence are exbhiasixed and rewarded by 
faculty and student-bodies, individual students tend to achieve at higher 
levels. 
Summers and Wolfe (1975) presented data that support the influence 
of the student -body characteristics on the academic achievement of. in- 
dividual members. They found that ‘the proportion of either high achievers 
or low achievers in i: wane can influence the student's rast performance. 
The more heterogeneous the composition of the student body was in terms i 


of abilities, the higher the achievement of the student body. They. also 


found that both black and non-black students tend to have higher achievement 
é ~ -26- 
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levels’ when schools are racially balanced than whernthey are mostly 
segregated. ‘ . . 
4 é a 

On the other hand, Smith (1972), after a reanalysis of Coleman's 
data, concluded that there is ‘és yeamacn st the characteristics of the 
student body have a strong independent influence on the achievement of . 
individual students. He concluded that the student selection and school 
‘Sealandant policies cause the association between student body character- 
istics and sckhenenani: 

in. inte seudew of literature, edie, et al. (1972) eoneiudad that 
there is no stwond evidence to support the hypothesis that student-body 
effects wate ‘nor $s there eneiis evidence to the contrary. They added that _ 


the controversy over the existence of student-body effects results from 


4 
ry 


ge 


research methological considerations. 


So long as production-function research is based on data generated 

by natural experiments, it will be difficult, if not impossible, 

to isolate completely the relatiye contributions of school resources, 
background factors, and peer-group influences. (p. 44) \ 


Thys it seems reasonable to conclude that the role of the student ae 
body on the achievement of individual students is not yet known. At the 
same time, the existence of student-body effects on Sadao academic 
sditnimasak is \hypothesized. 3 - ; 
‘ : 


, Student,'sy self-concept. The student's self-concept, or what the 


student believes he is, has been studied in terms of influence on school 
performance. is review of this research literature, ‘Purkey (1970) 

found that the relationship between the self-concept and academic achieve- 
ment can be divided into three categories: (1) the relation between the 
self-concept and success in school; (2) how the successful student views 
himself; and (3) how the unsuccessful student sees himself. He found 

that the research clearly indicates "a saralabant and significant relationship 


“ 


« 
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between the self-concept and academic achievement." (p. 15) The relation- 
ship is clear for boys but less'so for girls. Successful students are 
generally enesactert sad by positive self-concepts and tend to excel in 
feelings of worth as individuals. On the contrary, underachievers, non- 
achievers, or poor read@rs are likely to see themselves as less able, less 
adequate and less self-reliant than their more successful peers. 

In a study of educational achievement akg ethnic group membership, 
Pollard (1973) found that the only panmananlke variable that correlated e 
consistently with achievement in all five ethnic groups was the self- 
concept of ability. It was the only variable that differentiated high 
achievers tron “low achievers in both reading and arithmetic. 

Though vaneurch ‘in the self-concept has many limitations, it seems clear 
that this variable influences student educational outcomes. 


Student's general ability. seit most people agree that general 


intelligence or ability influences academic achievement, thip gener 


is a matter of some controversy among researchers. Low corfelations between 


mental test scores and learning have been found in some studies (Cronbach, 


~ 


1970). On the other hand, some authors have pointed out that general ability . 
appears to be the single most effective predictor of school achievement 
(Entwistle, 1972; McDiil, es Cronbach (1970, pp. 293-294) explained. this 
inconsistency of findings in terms of:the kinds of learning considered. 


First, it is true that in instruction that presents connected 
materials - whether by a programmed text, a live teacher or 

some more exotic method - the pupils high in mental age learn 

more than those low in mental age. Hence MA does represent one 
kind of ability to learn. When, however, the material is rote 

in nature, and ne meaning can be supplied by the learner (as in 
many laboratory tasks) good general ability gives little or no 
advantage. There is some reason to think that rote memory is a ° 
separate ability. Good performance on a truly rote task may occur 
as often among those we call 'dull' as among the bright. 


Cronbach (1970) also presented evidence of interactions between general 
e -28- 
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ability and instructional method. " Instructional methods or treatments 

can be found to be differentialiy effective on the basis of the level of 
the student's general ability. This can explain in part the failure in- 
educational research to demonstrate positive effects due to new treatments 


‘or instrutional innovations. 


ae . 
Other student's attitudinal and motivational factors. In the Equality 


of Educational Op portunity survey, Coleman, et al. (1966) found that a set . 

of e"" attitudinal measures saesintak for Riv Schutte variability 

than any other set of variables. These attitudinal meabures were 

(1) the student's interest in school and his reported reading outside school; 

(2) the student's self-cbncept, especially with regard to learning and success 

in SehOSTs and (3) the student's sense of centred over his own destiny. Ge 

these attitudinal measures the one that was found to have thé strongest re- 

ationship to achievement was the student's sense of er over his own destiny. 
In their reanalysis of the data used by Coleman, et al., Mayeske, et al. 

(1973) found evidence that supports the existence of a relationship between 

student's attitudinal and motivational factors and academic achievement. 

Among these factors the most important were the student's expectations of 

his performance in school aia hak attitudes as to the importance of hard 

work for sient and how an saaeaticn aight benefit him. 

A particular aspect of motivation that has been considered in many 

studies is achievement motivation or the need to achieve. Although this 

variable has frequently been associated with school performance, a consistent 

direct relationship hds been difficult to demonstrate. Pollard (1973) - 

indicated that this is due partially to the problem in conceptualization 

ae partially to the possibility that other variables mediate the effect 


of achievement motivation. . 
43 _ ’ 
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Ina bali of research about the prediction of achievement from a 
measure of achievement motivation, Klinger (1966) reported that of five 
studies, two report that children with high achievement motivation scores 
had significantly higher achievement than thosé with low scores in achieve- 
ment motivation. The other three studies report that achievement motivation 
scores did not differentiate high from low achievers. 

In a recent study, Simons and Bibb (1974) estimated what they called 
a *eesultant achdevennt-sotivecion Lites,” atts index was obtained by 
combining an individual's need to achieve with his test anxiety score and 


was supposed to represent a single measure of overall. motivational character. 


It was discovered that the resultant achievement motivation index was 


associated with student achievement.’ This index is interpreted in terms of 
hope of success or fear of failure. The authors concluded that "the hope 


: ° 
of success was significantly associated with high or superior academic 


« 


achievement while fear of failure was significantly associated with under- 


achievement." (p. 366) 


_ Summary and critique of research on variables : 4en 
Most research has demonstrated that the largest percentage of the 

variance in student's educational outcomes is associated with student 
‘characteristics. Student's socio-economic status as well as his self- 
concept, other al ac and motivational factors and his general ability 
seem to be very important in explaining variability in student academic 
achievement. On the other hand, a small paeneubags of that vaslance has 
been associated with Pree variables. Research has not identified a set 
of adicational practices and/or resources that consistently relate to 
student's educational outcomes. A practice that seems to be effective 


i 
in one case is apparently ineffective in another. 
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This does not mean that school does not affect student educational 

outcomes. Most research compares variables and educational outcomes 

across schools and little knowledge is available as to what student's 
outcomes would be in case they do not attend school at all. There is a 

need to explore further the influence of the school on some of the variables 
that ‘have been proved to be strongly associated with academic achievement, 
such as self-concept, ability and other attitudinal and motivational factors. 
It is possible. ‘ita the achive! affects student's outcomes in many indirect 
ways. a | 

There have been few studies on the effect of the interactions between 

phevaent variables and school antes on shodsneie outcomes: Soar (1975) 
found interactions between pupil sevio~scononie Stare and achievement gain 
for several kinds of teacher behaviors. For example, ".. . teacher , 
enclelan of pupil work is negatively related with achievement gain for 

low SES pupils, but not for high SES pupils; whereas a warm, supportive 
atmosphere is positively associated with gain for low SES pupils but not 

for high SES pupils." (p. 3) Summers and Wolfe (1975) studied the question 
of the interaction between specific school resources and specific as of 
pupils. As a result they found more strong school influenceson student 
achievement than in previous akodine. Previous research mostly considered 
the relationship between school Vectabien and the outcomes of all students. 
Thus it is possible that the positive influence of the school on certain 
kinds of students may be cancelled by the negative influence on other kinds” 
of students and in this way saiwol, dagiueacen may be hidden. It is hoped 
that future researchers following and improving on Summers' and Wolfe's 
research methods will be able to discover the influence of school in student | 


educational outcomes. 


- actions between student-teacher, student-student, student-subject-matter, 


’ 


The available research also is limited in other ways. The educational 
outcomes considered are almost exclusively those associated with cognitive 
achievement, but this is only one aspect of student learning. Furthermore, 
research considers cognitive achievement as measured by standardized tests. 
These instruments are limited since they measure a narrow range of cognitive 
skills, mostly the- lower cognitive processes. Higher coqnitive processes such 


' 


as abstract reasoning, problem solving and creativity, among others, are rare- 


ly measured very well by standardized tests. Thus of a wide variety of educa- 
tional outcomes, available research examines only a narrow range of cognitive 


a 


skills. 

Few studies maintain adequate controls over possible variables that can 

affect achievement, especially variables associated with what goes on in the 
3 Ee 


classroom (Averch, et. al., 1972). Most studies do not include data on inter- 


thscharnsul jectnatvex; student-teacher-subject-matter and so forth. 
Many variables are measured in crude form. Variables such as teacher 


quality, teacher's ability, student's motivation, etc. are theoretically 
. ? 


understood but are difficult to measure. Therefore, we do not know the extent 
to which inconclusive findings are the result of the researcher's inability 


to measure the variables included in his analysis. | 


In general the available research has identified the following as possible 


’ 


sets of variables that affect student educational outcomes: 


Strong support from research 


Socio-economic status 
Student's general ability. 


Some ‘support from research 


Family expectations, attitudes and ‘aspirations 

Peer group characteristics (student-body) 

Student's self-concept 

Student's attitudinal and motivational factors (ineluaing fate control) 
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Teacher training ; . 
Teacher experience | : 

Teacher expectations = 
Teacher behavior in the classroom. 


€ 


Variables to be used in the forecasting model 


Given the inconclusive nature of the research, a panel of experts of the 
University of Florida faculty was asked to assist in identifying the variables 
to be used in this study. The list of variables influencing educational out- 

Er 
comes identified through the review of the research was used as the basis of 
a modified Q-sort. The panel was asked to scrutinize the list and suggest 
additional variables which should be included. Discussion of the variables. 
by the panel resulted in the following additions to the list: 


2 


Teacher emic standards - as differentiated from the teacher's 
expectations of student's learning ability 


The normative system of the school 

Administrative leadership. 

Student's fate control sia identified as a separate variable. 

The vawuhebnd list of 14 variables was then sorted by each panel member 
“ina four-step forced-choice procedure to yield the single variable each judged 
to be most significant in influencing school outcomes . The next day a tabula- “3 
tion of the acute of the first sorting was presented to the panel and dis- 
cussed. Each member was given the .opportunity to change his choice as a result 
of his observation of the tabulated results and the ensuing discussion. The 
tabulation of the final sort was scored using a reciprocal anenkoad eluting 
(see Appendix A). The ordering of the variables through the modified Q-sort 
was closely conaruent with the results of the research review. 

The ten variables having the highest rating were selected to be used as 
components of the cross-impact matrices. These ten variables are listed below 


, 
with a brief explanation: 
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Socio-economic status of the family - usually measured by level of 
education and occupation of head of household 


Family expectations, attitudes and aspirations - the way parents 
and other family members feel about education and toward life 


Student's self-concept - the way the student sees himself 
Peer group characteristics. - academic achievement, race and attitudes 
toward school and learning 

- a” 


Student's general ability 


Student's fate control - individual's sense of control over his own 
destiny, his ability to influence the course of his life (locus of 
control) , 


Administrative leadership style 
t 


Teacher expectations regarding- learning ability of specific students 
or classes , 

Teacher behavior in the classroom - how the teacher actually carries 
out the tasks of teaching 


Student's attitudes and motivation - attitudes toward his performance 
in school and his motivation for achievement. 


ee 


SECTION V 


. Forecasts of Trends in Social 
Indicators of Educational Outcomes 


One purpose of this study was to forecast the trends of five social indi- 
cators of educational outcomes. The indicators were selected by personnel in 
the Department of Education for use in the forecast. In the previous section, 
ten variables that research indicated may influence these social indicators 
are described. In order to forecast trends in the values of indicators it was 
necessary to estimate er the trends of these variables would be. Then the 
interactions among the variables and the indicators could be estimated and a 
moxe reliable forecast made. As stated in Section III, the cross-impact analysis < 
technique was used to generate data as a basis for foxscesting 
Cross-impact analysis is a modigicution. of the Delphi fowyecasting technique. 


ta 


“at enhances the power and reliability of the Delphi technique through the use 


of a matrix and a computer program which helps analyze the data in the matrix. 

. Delphi uses an iterative process to obtain consensus among a group of experts 
regarding the pciuninniy of occurrence of some future event or set of events. 
Cross-impact analysis retains the use of a panel of experts to estimate the 
probability of occurrence of a series of events. By placing’ these probabilities 

in a matrix and utilizing a computer program it is possible to systematize the 
analysis of the interactions between events. The solution which results is F 


approximate rather than absolute, but it does extend the power of human judg- 


ment. The construction and use of cross-impact matrices is discussed in the 


pages which follow. 


Illustration of cross-impact analysis 
The nature and use of a cross~impact analysis can be described through an 


examination of the matrix presented in Table 3. The illustration concerns a 
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- Auto use continues to increase through 1990 Pe ee 


Table 3 


Hypothetical Cross-Impact Matrix for Forecasting 
Modes of Transportation by 1990 


Initial | Conditional 
ee 


Events 


An acute shortage of fossil suels occurs by (1990 r= fal te 


3. All major U.S. cities have rapid mass transit -65/.40] - 
systems in operation in 1990 


* ora 
hypothetical forecast regarding modes of transportation by 1990.° In any. 
cross-impact’ matrix the’ initial probabilities are determined through 
research findings and consultation with ineete in the field under consideration. 
The initial probability represents the estimation that an event will occur 


independent of all other events. In the hypothetical‘ matrix, Table 3, it is 


estimated that the probability that. auto use will increase through 1990 is 


-75. Brobability may also be stated as the odds on the occurr\nce of an 
event where these odds are equal to the probability that an event will occur 


divided by the probability that it will not occur. Probabilit ) . 
1 ~ Probability 


In the auto use example the odds = “oe = Jor3tol. The initial 
probability of event 2, an acute-shortage of fossil fuels by 1990 is .50, 
or odds of 1 to 1, indicating an even chance for this event to occur by 1990. 
Event 3, all major U.S. cities have rapid mass transit systems by 1990, is 
thought to be less likely than the other events and has been oak an ‘ 
initial probability of .25. 

The underlying concept of cross-impact analysis is that the initial 


probability of the occurrence of an event will be modified by the impact of 
. ~ 


other events in the set included in the matrix. These probabilities are 
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called conditional probabilities and are inserted in the matrix at the 
appropriate intersections. The events are arranged so that the rows and 
columns have the same events in them; for manta: auto use is found in 

row 1 and column 1. In the example shown in Table 3 the events are thought 
to have no impact on themselves so a dash has been inserted in the cells id 
where each event impacts Séaart: ‘Beginning with the top row and the second 


column the.meanings of the conditional probabilities are as follows: .80 - 


+ . 


If auto use aed continue to increase chioush 1990, the impact of that event 
on the probability of a fossil fuel shortage is to increase it from .50 to 
-80: .15 - If auto use continues to increase, the probability that all 
major cities will have mass transit systems in 1990 declines somewhat 

from .25 to .15. The conditional probabilities: in row 2 have the following 
meanings: .25 - The impact of an acute shortage of fossil fuels on the 
growth of auto use reduces the initial probability of that event from 75 
to .25: .60 - An acute shortage of fossil fuels by ‘1990 will increase the 
probability of urban rapid mass transit Yh att major cities from .25 to .60. 
The meanings of conditional probabilities HA row 3 are: .65 - If all major 
U.S. cities do have rapid mass transit systems by 1990, the probability 
that the use of the auto will increase is reduced from .75 to .65: .40 - 
If all major cities do have rapid mgss transit systems by 1990, the proba- 
bility of an acute shortage of fossil fuels is: lessened somewhat from 

.50 to .40. \ a # , 

This cross-impact matetr des analyzed by a computer program. The 
pebacan derives an approximate solution for new or "calibrated" pesbakd thbles 
for each event. It takes into account each of the conditional probabilities 
and their impacts on the initial probabilities assigned to each event. The 


workings of the program are described in greater detail later in this section. 
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The analysis of the sample matrix ae ine changes in the initial 
probabilities of each of the events. The probgbility that auto use will 
continue to increase through 1990, initially set at .75, was ‘calibrated 
to a final probability of .59. The diminution in the probability of this 
event indicates that the impacts of the other two events on it are strong 
enough to lessen the likelihood that it will occur. The probability that 
there will be an acute shortage of fossil fuels by 1990 increased from .50 
to «62, indtenting that this event is more likely to occur than was initially 
forecast. Finally the probability that all major U.S. cities will have rapid 
mass transit facilities in operation by 1990 also increased. It had an~ 
initial probability of .25, but when-the impacts of the other events are 
taken into account, the computer increased its probability to .33. 

The illustration shows how a cross-impact matrix is constructed and 
explains the meaning of the probabilities. However, it includes only 
three events and consequently does not give a clear picture of the power 
of the technique . Most experts can easily perceive the interrelationships 
among three events and can explore them in their own consciousness without 
artificial aids. Consider how different the situation would be if the entire 
set of events impinging on the transportation market were included. _Ten F 
fifteen, or perhaps more events would have to be included in such a neni. 
If there were fifteen events the number of paired interactions would be 
225. Keeping all of them in mind would east the mental powers of any 
thinker. In such situations the cross-impact matrix is of considerable 
value. In combination with the computer program which can show how the 
interactions oe event pairs would affect the initial probabilities, the 
matrix becomes a powerful tool with which to expiore alternative futures. 
This is the essence of cross-impact analysis. The pages which follow 
describe in detail how the technique was used in this project. 
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The use of cross-impact analysis in this project 


Table 4 is the matrix that was used to generate data regarding one of 
the social inateatoxs -- _— Reading Test seniiten for thirteen year-olds. 
Note mie the Matrix deals with events. ‘Thus, each variable is stated’as 
an event -- e.g., students' self-concepts will decrease by 1981. 

‘ Similarly, the indicator is stated as an event -- the scores on the NAEP 
‘tant for thirteen year-olds will increase by 1981. As with the illustration 
Ser vniters assigned to the columns correspond to the events given the 
same number in the rows. Thus, Column No. 5 refers to the event: students’ 
self-concepts will decrease. 

Estimatfon of initial pxebantii tien. The asaionnent of initial 
probabilities to the events is an important first step since these values 
will have a major influence on the forecasts generated. These probabilities 
should be based on data about trends in the influencing variables and the 
trbact thas. théie dattuanning waclablen have onthe aoctal. dadlaatore, 

, hi eaecmnaele: little of this information was available. With the exception 
of socio-economic status, time series data about the variables were not 
available. Even the data about socio-economic status have many limitations 
since the levels of income, occupation and education datectavietis ot 
different socio-economic status change through time. Nevertheless, the 
available data suggest that during the past a oie the percentage bf 
children living in low socio-economic status has increased. As pointed 

_out in Section III, one out of seven children was living in poverty in ’ 
1970, whereas one in vix children in American was living in poverty in 


1974. (Associated Press, 1976) Furthermore, the difference in income 


\ 
between classes is increasing as can be seen in Table 5, 
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Event 


Family expectations, attitudes & 
aspirations will decline 


Peer group expectations, attitudes 


& aspirations relative to education 
will decline 

Percent of children living in poverty 
will increase 

Students' ability as measured by IQ 


- tests will decrease 


Students’ self-concepts will decrease 
Students’ attitudes & motivation 
towards school will decrease 
Students’ 


Teacher expectations of pupil 
performance will decline 

Leadership styles and organizational 
climate of schools will improve 
Teacher. behavior with respect to 
instructional practices will improve 
NAEP test results for 13. year olds * 
will increase 


sense of control of their own 
- fate will decline 


- 


Table 4 


Cross Impact Ahalysis Matrix for _ 


NAEP Test Results 


Initial comet tonal Stee ; 
ae ll 
re tea al nl a ad al 


afta alata atatal ot 


| co | ce] ser] = | or] e570 | 70 | 60 | 2 | 00 | se 
|r| oof .s5| cal = | col - | - [sof ae] - | oo 
| ss | ox} sso] 7] so] - | 72 | ra | sr [ae | 00 | 00 
| ss | 7] 67] 05] .54| .50| =| 65 [50 [aa | - | oo 
| es | 66] 60] 07] 66] [re] - [se |do | oo 
joi |= fee] = Jas | | 
[ae | so[.s1 | ae] - | 67 | 
ae ee 


749 49 .54 = 


' Table 5 ." ; 
Ratio of Mean Income of the Highest Fifth to the 
Lowest Fifth oP families: 1968-1971, U.S.A. 


: a, 
‘ ~ 
oe ae ee eo. 
| Cighest Fifth to Lowest Fifth soN 
1968 — 7.14 
1969 - 7.32 
1970 7.56 
1971 P 7.56 


Source: Social Indicators, 1973 prepared by the Office of Management 
and Budget of the Executive Office of the President. ‘ 
. - - 
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Ranges of probabilities of the impact of the variables on the social 


indicators were impossible to establish based on the available data. Different 
studies have used different statistical analysis of their data having established 
relationships in terms of probabilities in some opsts and in terms of percen- 
tages of Gaxiaiee in others. Also, the findings in many cases are very consis- 
tent. Furthermore, the data available are limited to relationships between : 
influencing variables and Ganaeavice test er Relationships between 

these variables and other social indicators have rarelv been considered. How- 


ever, in this project it was assumed that the variables affecting test results 


would also affect other variables. 
The lack of data regarding past trends in variables made the task of fore- 
casting their future difficult. The researchers were able, however, to draw 
on the varied ppartenens of members on the faculty panel in assianing initial 
and conditional probabilities. After sharina relevant‘ information with each 
other, members of the panel estimated the probability that each of the events 
listed in the matrix would occur by 1981 which was the time frame used for 
this forecast. The mean score of their estimatioh was used as the initial- / 


probability. The initial probability assigned to the social indicators was 
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always .50. In other words, the assumption was made that there was a chance 


probability, or one-to-one odds, that the indicator will increase in value. 


Estimation of conditional probabilities. The second step was to estimate 
the impact that each event would have on each other event, that is, to assian ; 
conditional probabilities. In order to make this estimation, a series of 
questions were asked, in the vn: "If in fact event No. 1 occurs, how wit 
this affect the probability that event No. 2 will occur?" In Table 4, for 
example, if in fact family expectations, attitudes and -aspirations do decline 
(event No. 1), how will this affect the probability that peer group expecta- 
tions, attitudes, and aspirations (event No.2) will decline? The estimation 
that was made indicated that the occurrence of event No. 1 would increase 
the pxobantxity that event No, 2 would occur. Thus, the initial probability 
of 54 was incsedsed to .63 (the first cell in the second column) . The faculty 
panel provided the estimations of impacts. : : 


Column 11 of Table 4 shows the estimates of the impacts of each of the 


variables on the social indicator. Thus, it was estimated that if in fact 


~ . 


students' self-concepts decrease the probability that the scores on the NAEP 
test for thirteen year-olds will increase would decline. Thus, the conditional 7 
probability assigned is .40 somewhat less than the ititial probability of .50. 
(the fifth cell in column No. 11), The estimation of impacts on the indicator 
is particularly important to the results. The faculty panel had read the 
review of the research contained in Section IV of this report prior to making 


their estimations of these impacts. 


Computer analysis of the matrix. After the initial and conditional pro- 
babilities had been assigned, a computer program based on Bayesian statistics 
‘and using Markov chaining and the Monte Carlo technique wasw used to improve 
the estimated initial probabilities of all the events. The computer proaram, 


developed by the Futures Group, uses the ratios between the initial probabi- 


\ 
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lities and the conditional probabilities to determine the odds for the occurrence 


of an event. Then it selects a random number between 0 and 1 and Sompares 

it a the initial probability of a randomly selectéd event to Sesusates LE the 

event occurs or not. If the event occurs new odds ratios are calculated for ° 

every other event on which it has an impact. Then another event is selected 

at random and its new initial probability, based on the adjustment in the odds : 

ratio is compared with a random number and the whole process is repeated. 

The program allows the user to specify how aay timés the whole set of events 

is analyzed in this wav, 1200 is thought by the program's authors to be optimal. 

The result of such a computer run is a new set of probabilities calibeated 

to take into account the impacts of all the events upon each other. ” These 

calibrated probabilities can be used as a eee for forecasting on the assump- 

tion that they more closely represent the actual pxchabtility of an event than 

the first estimates. ; ; fa 
Table i the results of the cross-impact analysis of the matrix 

shown in Table 4 based on 1200 iterations. The initial probabilities in Table 6 


correspond with the initial probabilities in Table 4. The calibrated proba- 


s 


Table 6 
Calibration Results for 
Matrix in Table 4 


INITIAL CALIBRATED 
EVENTS PROBABILITIES PROBABILITIES DELTA 
E 1 0.64 0.60 -.04 
BE 2 0.54 0.66 0.12 

. E 3 0.60 0.68 0.08 
gE 0.61 0.57 -.04 
BE 5 0.56 0.60 - 0.04 
E 6 0.65 0.69 0.04 
E 7 0.63 0.68 0.05 
E 8 0.55 0.57 0.02 
E 9 0.41 0.48 0.07 
E 10 0.50 0.54 0.04 
E ll 0.50 0.17 -.33 
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bilities are modifications made by the program in light of all the interactions 


among the events. Delta reprefents the sistance between the initial proba- 
bility and the calibrated probability. ee example, seceraing to the computer 
analysis, a better estimation of the probability that peer group expectations, 
attitudes and aspirations will decline {E2) is -66 instead of .54, given the 
impacts of the other ten eves on event No. 2. 
of pattleales interest is event 11 -- NAEP Reading Test results for 

thirteen year-olds will increase by 1981. According to the computer analysis ~ 
the cross-impact data indicate that a better estimat%on of the probability 
that scores will increase is .17 instead of .50 as initially assiqned. This 
can be stated another way by saying: Assuming that the interacting variables 
designated by events 1-10 in Table 4 have the probability of occurring as 
represented by the calibrated probabilities, then the probability that NAEP 
“Reading Test results for thirteen Year-plds.wil} increase should be 0.17 rather 


than .50. Stated as odds, the odds are only 1 to 4.88 /.17 = .2048, or 1 to 
-83 


4.88) that the scores will increase rather than the originally assumed 4 n 
odds of 1 to l. ne 

It should be emphasized that this solution is indeterminant. The computer 
program only apprekinates the actual value since a sampling technique is used. 
In fact, if the same matrix is analyzed in another computer run the values 
of the calibrated probabilities can vary slightly (usually not over .02). 

Table 7 shows the result of analyses of matrices containing each of the 
five indicators. Initial and conditional probabilities for events 1 to 10, 
the variables affecting educational outcomes, were the same for each matrix. 

' 


The five aa social indicators were considered in tum as Event ll. 
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Table 7 
Calibrated Probabilities of Occurrence of 
Increase in Social Indicators 


: Initial Calibrated 4 
Social Indicator Probability Probability Odds 
"NAEP reading scores for . 
thirteen year-olds will increase 50 = Ie 4 1 to 4.88 
Eighth grade test results will 
increase : -50 16 L. to.'S.,25 


The percentage of the labor force 
that is unskilled will decrease 50 24 1 to 3.17 


The per capita circulation of 
newspapers in Florida will increase .50 26 1 to 2.85 : 


The percentage of armed forces 

inductees from Florida who fail the 

mental tests upon induction will 

decrease -50 .19 1 to 4.26 


The results shown in Table 7 indicate that the odds that indicators will 

increase are relatively small with the two indicators most closely associated 

with schools (the first two in Table 7) having the poorest odds of increasing. 
Obviously the initial and conditional probabilities assiaqned will laraely 

determine the outcome obtained by computer analysis. For example, the enumediiee 

constructed a matrix that was very optimistic by Sosatad events 1 through 8 

from negative statements to positive statements and increasing the initial 

probabilities for events 9 and 10 from .41 and .50 to .55 and .60 respectively. 

The rest of the matrix was unchanged. When this matrix was run on the computer a 

there was a dramatic difference. The calibrated probability that there would 

be an increase in NAEP reading test scores moved to -97, .47 above the initial 

probability. In other words, the odds that the scores would increase moved 


up from one to one to thirty-two to one! ° 
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Forecasts of social indicators 


Based on the data generated by the forecasting model, the researchers 


forecast that the five sociak indicators will decrease over the next five year 
period. These indicators are: 
NAEP Reading Test scores for thirteen year-olds 


Eighth grade test results i 


Percentage of the labor force not designated as unskilled 


4. Ciroulation of newspapers in Florida per capita - 


e* 


ei Percentage of armed forces inductees in Florida who pane the mental 
tests on induction. 


The researchers hope that subsequent events will prove them-incorrect. Four 
of these five forecasts can he verjfied by accumulating si iedecsdty data. 
The indicator related to armed forces inductees cannot be verified because 
comparable data are no longer being collected. 

What effect would changing the basic assumptions have on the forecasts? 
As indicated above a "rosy world" forecast has a dramatic effect. The impact 
of various other assumptyggons on the indicator, NAEP Reading Test scores for 
thirteen year-olds, were tested. , The first assumption was to suppose that 
events sare line direct control of 'the school would be very likely to occur. 
They were assigned corresponcingly high initial probabilities. The followtag 
changes were made in initial probabilities of the matrix in Table 4. 


8. Teacher expectations of pupil performance will decline -- .10 * 
(formerly .55) 


* 7 


9. Leadership styles and organizational climate of schools will saprove = 
-90 (formerly .41) 


» 
. 


10. Teacher behavior with respect to instructional practices will improve-- 
v4 -90 (formerly .50) 


After appropriate changes were made in the conditional probabilities the new 


matrix was analyzed. The new calibrated probability for an increase in NAEP 


~46- 2 


- & 61 


reading test scores was ao an increase from the calibrated probability of 


4 


.17 on the original computer run. In other words modifying these factors 
improved the odds of an increase in reading scores from 1 chance in 4.88 up 
to 1 chance in three. 


Events numbered 5, 6, and 7 in the matrix displayed in Table 4 are variables 


which can be influenced by the school. The next computer run was based on a 


~ i ; 
matrix further modified from the one just described by making changes in the 


eee probabilities of: ” ’ ' 


Be Students! self-concepts will decrease -- .20 (formerly .56) 


Students' attitudes and motivations towards school will decrease -- 
-20 (formerly .65) 


7. Students' sense of control of their own fate will decline -- .20 
(formerly .63) 


After appropriate changes were made in the conditional probabilities, the matrix 


was analyzed and the new calibrated probability for event 11 was .36. This 


time the odds improved fufther from the original 1 chance in 4.88 to 1 chance 
in 2.73% 
Another variation on the original matrix was tried by changing probabi- 


lities assigned to events ordinarily thought of as outside the control of the 
= 


school. All other events remained as in the original matrix. The following 
‘ values were assigned in order to present ‘a more optimistic picture: 


1. Family €xpectations, attitudes,and aspirations will decline ==_.20 
(formerly .64) 


Zs Peer group expectations, attitudes, and aspirations will decline -- 
-20 (formerly .54) 


. 


3. Percent of children living in poverty will increase -- .20 (formerly 
-60) ‘ 


‘ 4. Students' ability as measured by I.0. tests will decrease -- .20 
(formerly .61) 


LY 
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When appropriate modifications were made in the conditional probabilities and 
the resulting matrix was analyzed by the computer, the probability that NAEP’ 
reading Seas results of thirteen year-olds would’ improve was .25. This pro- 
bability is the same as the probability which resulted when events directly 
under school control were optimized. Both increase the odds that NAEP test 
results will improve from 1 to 4.88 to 1 to 3. 

Finally all the probabilities werd reset to reflect a situation in which 
the impact of negative trends outside school control was decreased and the 
impact of\events under the control of or which coild be pee by the. school 
was optimized. Cease analysis of the resulting matrix yielded a probability 
‘of £45 for the indicator, ssue-shaalas test results for thirteen year-olds -- 
odds of 1 to 1823 
Discussion of forecasts 

One interpretation of the weds ties of this phase of the study might be 
that the influence of community factors is so great that schools cannot coun- 
decane a poor home and community environment. It is true that our research 
supports the contention that the commun ity exerts a power ful influence on 
educational outcomes. At the same time our research supports the importance 
of the school. More importantly, the study highlights the crucial importance 
of an effective interaction between the school and the community in relation 
to educational outcomes. 

The interaction between school and community becomes apparent through 
studying the matrix in Table 4. idesaats inspection it was found that event 
number three’- percent of children living in poverty will increase - had a 
greater impact on the other variables than did any other variable. This inspec- 
tion involved a comparison of the conditional probabilities and the initial 


probabilities as influenced by event three as compared with other events. 


® . 
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This etadine is in agreement with research studies that emphasize the impor- 
tance of socio-economic status on student achievement. If socio-economic 
status (in this study represented by the event: ~pertéent of children living 
in poverty) has such an impact on the other variables and thus on educational 
outcomes, what has an influence eh socio-economic status? Socio-economic 
status is generally defined by the level of income, amount of education and ’ 
occupation of the head of the household. But what factors influence level 
of income, amount of education and occupation of an individual? Pieante one 
of the most important factors is the amount and quality of education of the 
N Anaiviaua: n 
Thus theré is a mutually dependent and "spiraling relationship" between 
education and socio-economic status. The extent and quality of an individual's 
education will affect his socio-economic status which will in turn affect 
the educational achievement of his children. this will affect the socio- 
economic status of his children, etc. For 194 years after the founding of 
this country the spiral was generally up with socio-economic status improving 
for generation after aeneration, at the same time that. educational acHievemgfts 
improved. The last six years have witnessed a downturn in the spiral wit 
an increasing number of children living in poverty and declining test scores 
Periodic fluctuations in economic progress can be confused with long 
range trends. If this is another Berinsic fluctuation the effect will be short 
lived and limited in scope. If events prove otherwise and a general decline 
has been reversing previous trends the educational results could be arave. 
The findings of this rroject in no way suggest that the school should 
take a defeatist attitude. father the findings emphasize the necessity for a 
concerted effort to influence as many variables as possible. Simply changing | 
methods used in teaching or providiha ne materials will probably not. reverse—— 
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MY a general downward spiral. Nor will passing laws on standards, minimum com- 


petencies and accountability. If there is one lesson to be learned from this 
research it is that simplistic answers ‘must be replaced by holistic approaches 
that involve the community, the home and the school. 

One practical demonstration of the value of such ‘an approach is the parent 
education program developed by Gordon. (Gordon and Breivogel, 1976) This 
program has demonstrated its potential for influencing a number of the variables 

‘ 
identified in this study -- both those in the home and in the school. 

One hazard in makina forecasts such as those presented in this section 
is that teachers and parents may assume that little can be done to improve 
the situation.” This leads to the worst kind of self-fulfilling prophecy. 
Clearly, some methods of teaching are superior to others. Benjamin Bloom has 
araqued that ". . . virtually all children could be taught everything that 
the schools have to offer so long as the correct methods were sued." (New York 
Times, June 9, 1976) Dedicated and skilled teachers with appropriate teaching 
Paaneions can in fact improve the quality of education. Their efforts will 


be greatly enhanced through the understanding and cooperation of parents and 


the community. a 


a 
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SECTION VI 
- Forecasts with Selected Interventions 
Identification of issues e 

One of the main steps in the forecasting model is the identification of 
future issues that would reauire policy decisions that would in turn affect 
the influencing variables and the social indicators. The identification of 
these issues was done by the faculty panel in consultation with futurist 
Dr. Jay S. Mendel] “from Florida Atlantic University. Mendell played the role 
of provocateur in helping the panel come 6b apibe with this forecasting pro- 
blem. His approach was based on the assumption that experts in any field, 
given sufficient provocation, are likely to find within themselves images of 
the future which include the important issues that will face policy-makers 
in their area. These issues were refined in small group sessions in which 
they were analyzed to bring specific issues more clearly into focus. Larger 
issues to which these relate were identified, as were more narrow issues which 
they subsume. 

Twenty-five issues were identified by the panel. Some of them were 
directly related to education while other, broader issues, although not exclu- 
\ sively educational in scope, were seen to have possible implications for educa- 
tion. A perusal of those issues revealed the close interrelation of some of 
them. Accordingly the issues were revised by these researchers to the follow- 
ina: 


Ls What provisions should be made for inducting youth into the world 
of work? 


2. How can Florida provide for orderly economic growth? 


3's How can the state restore conficence at a time when trust in schools 
and other institutions is at a low ebb? - 
Lf 


en 


4. What is the school's role in solving social problems? 
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/ ais Should each community have a board of community education respon- 
sible for setting goals, coordinating programs and allocating 
ny resources? , 


6. How shall we meet the challenges of an aging population in Florida? 


Te Under conditions of economic stress, how can quality education be 
maintained? 


8. Should the number of years of compulsory schooling be reduced? 
; Should compulsory education be abolished altogether? 


SY 


9. Should legislative decisions attempt to reverse the trend of a 
growing diparity between social classes? 


10. Should stat& resources be used to support all educative agencies, .- 


Po not just public schools, colleges and universities? 
« ll. What islthe state'g responsibility for providing educational oppor- 
tunities for all F deacii and at all levels? 
» 
: 12. What;is the role” of the, schools in the socialization of youth? 


13. How should Florida supply industry's labor needs? 


14. What is the role of education in assisting citizens to identify 
and solve "means" problems and “values" problems? 


15. How can Florida meet its needs for energy and natural resources? 

Having identified these issues, the next step was to select the more 
salient ones to be used in the forecasting model previously described. The 
revised list of issues was used as a basis of a Q-sort. The list was sent 
to each panel member who wag, asked to sort it in a four-step forced choice 
procedure to yield the single issue he judged to be the most important in 
affecting education (see Appendix B). A tabulation of the results was scored 
using 4 reciprocal weighting system similar to the one described in Appendix 
A. The six issues haying the highest weighted scores were selected to be used 
in the forecasting sede and were ranked as follows: 


“4” 


1. What is the nk " responsibility ‘for providing educational oppor- 
tunities for all “citizens and at all levels? . 


26 What is the role "of education in assisting “citizens to identify and 
—solve "means“-problems and “values” problems? 


a6 Q< 
a 
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a Under conditions of economic stress, how can quality education be 
i maintgined? ~ ‘ 


4. How can thal seats Festore confidence at a time when trust in schools 
and other institutions is‘ at a low ebb? 


5 , 
se How can Florida meet its needs for eneray and natural resources? bad 
e i 
65 How can Florida provide for orderly economic growth? 
. 1 
Identification of alternative decisions a= 


. 
. 


Once the issues were identified the next step was to identify imenatve 
decisions on each issue. This was done with the assistance of the faculty. 
panel. First, a small group of members of the panel discussed and singontel 
some alisiniative decisions for each issue. Then this list was presented to 
the whole group*who discussed and revised it. As a result of this procedure 
the- following alternative decisions were suggested for each of the issues. 


Siig What is the state's responsibility for providing educational opportunities \ 
for. all citizens and at all‘levels? 


A. Strenathen the role of the family in the education ‘of os child. 
Bs Establish BREN child care facilities. 


IT. What is the role of education in assisting citizeps to identify and - 
solve "means" problems aoe "values" problems? . 


A. Design a curriculum which stresses problem solving methodologies 
dealing with “means" problems and "values" problems and includes 

. opportunities for all ages and groups to explore problems central 
.to their lives and crucial to our society. ?® 


B. Design a curriculum which focuses on cognitive skills and understandings. 
Tits. * Under conditions of economic stress, how can quality education be main- Py 
tained? 
2 . A. Allocate ‘resources eeed on a continuous assessment ral cognitive 
learning in relation to aconmate input. _ 
, : ee. 
B. Alloca resources based on a continuous assessment of quantity 
and ayality of education in relation to the needs of an increasingly 
¢omplex society as measured hy cognitive and non-cognitive skills. 


TV. How can the state restore confidence at a time when trust in schools 
and other institutions is at a low ebb? 


‘ “A 
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Work out structures and procedures and implement a program which 
encourages the public to be involved in working out solutions to 


problems of the educational enterprise at every level of education. 
* Ld 


B. Develop a public relations program for the schools. 


How can Florida meet its needs for energy and natural resources? 


A. Develop a series of instructional packages to inform and focus on 
issues related to Florida's natural resources. 


B. * Support both basic and applied work of the most knowledgeab {Le scholars 
_in the field of energy. 


How can Florida provide for orderly economic growth? 


A. Develop a series of instructional packages to inform and focus on 
issues related to Florida's os growth. e 


B. Incofporate in the curriculum’a study of the historical consequences 
of different economic policies and planning. 


. 


The altermatives identified are not ” paeualiy exclusive. For example, in 

finding answers to the Bues Eton, "What is the state's responsibility for pro- 
‘ a 
viding educational opportunities for all itizens and at all levels?" two . 
alternatives are given: 
va a 3 . 
A. Strenathen the role of the family in the education of the child. 
B. Establish early child eteciainls : \ 
=A < : S 

Both of these strategies could be llowed; however, one may be preferable. 


Responses to this question also lustrate that the alternatives do not cover 


all ener, responses. For example, the alternatives do not address the 
question of/education for various ages of adults. 


Estimates of the impacts of alternative poli decisions on the social indicators 


After the alternative policy decisions regarding the issugs were identi- 
fied, their impacts on nes the social indicators were estimated, ‘In order 


to do this, the members of the panel estimated probabilities of the impact of 


rf 


qeach alternative decision on each event (on the, influencing variables and on 


the indicators). The alternatives suggested for issues V and vI were ae judged 
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to have a sianificant impact on social indicators. (This is not to imply that 
these alternatives are not valuable.) Thus, the cross-impact analysis was 


used only with alternatives in issues a thro IV. Since there were eight 


alternative decisions, eighty-eight esti ‘were required. Therefore, 
. panel was divided in two groups each Which worked on four of the deci- 


sions. For the purpose of cross-impact analysis, the alternative decisions 


were treated and referred to as interventions. The following directions were 


read to the panel: 


Please estimate the impacts of the interventions on each of the events 
(variables and indicators). We will use tHe probabilities for impacts 
of the variables on the indicators which you assianed at our previous 
meeting. Each intervention should be considered by itself, not in re- 
lation to°other interventions. 


Each member made his estimations in relation to occurrence of events by 1981 
(the time frame used for this forecast) on a tabular sheet Siqdlar to Table 4, 
The mean prohabilistic estimation of the impact of each intervention on 


each variable and each indicator was used in the cross-impact matrices. Each 


intervention was used in a separate matrix with one indicator and all the 


' is ‘ 


variables. Since there’were eight interventions and five indicators, it was 
necessary to analyze forty matrices. 

Table 8 shows the forecast values of the impact of each intervention on 
each social Pyicator. The probabilities included are those that were#ali- 
brated by the computer after the impact of selected interventions on each of 
the ten variables was analyzed. In aqeneral most of the interventions did 
increase slightly the probability that the social indicators would change in 
a positive direction. The interventions that were consistent in this effect 
were: ” 

1. Strenghten the role of the family in the-education ofthe child. 

2s 2 Desian a curriculum that stresses problem solving methodologies 
dealing with "means" problems and “values problems and includes 


opportunities for all’ ages and groups to explore problems central 
to their lives and critical to our society. 
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Table 8 


\ Forecast Values of the Impact of Different [. INDICATORS 
: Interventions on the Social Indicators 
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Base line values (see Table 7) 
Establish early child care facilities 


Strengthen the role of the family in the educational process 
a: 
Design the curriculum to Higsd aealabad problem Solving processes for 
means and values issues 


Focus the curriculum on the teaching of cognitive skills | 22] .26| 
Allocate resources for education on the basis of 4ontinuous 

assessment of cognitive learning 
Allocate resources for education on the basis of continuous 

assessment of both cognitive and noncognitive learning rr .27 


Increase {éhe involvement of the public in every level of the ae 


educational system 


Increase public confidence in education through an intensive public lege 
relations program Lz .27 


35 Allocate resources based on a continuous assessment of cognitive 
learning in relation to economic input. 
{ 


4. Allocate resources based on a continuous assessment of quantity 
and quality of education in relation to the needs of an increasingly 
comp! x society as measured by cognitive and non-cogni tive skills. 
Bis Work out structures and procedures and implement a program which 
encourages the public to be involved in working out solutions to 
problems of the educational enterprise at every level of education. 
Of these interventions that consistently increased the. probabilities of 
an increase in the indicators, the, first two produced the largest changes. 
It seems that these interventions could be effective in improving the educa- 
tio outcomes. The intervention "Focus the curriculum on cognitive skills 
and understandings" decreased the probability of three indicators and produced 


no change in two. It is forecast that this intervention is not effective in 


improving educational outcomes. 
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SECTION VII 
Summary and Recommendations 


Summary . 

This is the report of a study conducted under.a grant from the Board 
of Regents of the Florida State University System and the Florida Depart- 
ment of Education. The dijactives of the study were to identify social 
indicators of educational outcomes, to forecast the future status of 
selected social indicators and to make policy recommendations. 

Social indicators were defined as a quantitative or qualitative state- 
ment that provides information regarding the status jof Florida citizens 
in relation to one or more ak goals of eas Florida. Social 
indicators were identified by eauiiecing measures of: the level of 
knowledge and skills, the ability to seby kndwlades and skills, and the 
utilization of knowledge and skills. Sixty-three different social indicators 


were proposed. The following five indicators were selected by the Department 
a 
of Education to be used in the forecasting process: ° 


1. Percentage of armed forces inductees who fail the mental test 
upon induction é 


2s “Eighth Grade Test results 
3. NAEP Reading Test results for thirteen year-olds e 
4. Number of newspaper subscriptions per capita 
5. Percentage of labor force unskilled. 
A model was developed to use in forecasting future values of these 
‘ indicators. An important component of this model is the identification of 
variables that may affect the social indicators. In order to identify 
them a review of eine’ literature was conducted. A faculty panel 
assisted the researchers in identifying the most important variables 
through the use of a modified Q-sort. Those identified and used in the 
study were: 
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1. Socio-economic status of the family 

2. Family expectations, attitudes and aspirations 
3. Student's self-concept 

4. Peer group characteristics 

5. Student's general ability 

6. Student's fate control 


7. Administrative leadership style 


8. Teacher expectations regarding learning ability of specific 
students or classes 


9. Teacher behavior in the classroom 
10. Student's attitudes and motivation. 

The indicators and the variables were used to eonakeuct a series of 
cross-impact matrices. In the matrices, the indicators and the variables 
were stated as events to occur in the future. An example of an indicator 
stated as an event is: the NAEP Reading Test score will increase by 1981. 
Then, with the assistance of the faculty panel, probabilities of pacinbanda 
of each event were assigned. Further, the impacts of events on each other 
were estimated. Through the use of a computer program, new probabilities 
were developed for each event. These data were then used as the basis for 


the generally pessimistic forecast that the values of the five social 


indicators used in this project would decline by 1981 if present policies 
and conditions persist. 


Re commendations 


Three types of recommendations have been developed through this 
project: (1) recommendations related to forecasts of trends in social 
indicators, (2) recommendations regarding the goals of education in Florida 


and (3) recommendations regarding the process of planning for education 


in Florida. To prepare recommendations related to forecasts of trends | 
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was the svecific charge to the researchers. The other two types of 


recommendations represent, as it were, by-products of the work on this 


project. 


Recommendations related to forecasts of trends in social-indicators. 


Section V of this report presents a forecast that if presént trends and 


policies continue, the values on five social indicators will decline 
during the period 1976 to 1981.. Given this forecast, what policy changes 
can be made to achieve more ieateabie futures? In order to answer this 
question, the faculty panel assisted the researchers in identifying six 


important issues that will face schools in the future. They also developed 


alternative retSponses or interventions, to these issues. (See pages 53,54) 
The panei then estimated the impact of these interventions on the variables 
and on the social indicators as described in Section VI. c 
Table 8 indicates forecasts of the effect of following various 

F “aleeenatiews on trends in social indicators. The results are not dramatic 
and for good reason. First, the forecasts were to cover trends in indicators 
only until 1981. The impact of many of the alternatives may be minimal in 
the next five years -- a forecast range of 20 to 25 years may be necessary 
to encompass the full impact. A second reason that no one intervention 
provides a large impact is that a number of variables affect educational 


& wot * 


outcomes. A single”intervention, unless it can affect a number of variables, 


will have a relatively small impact. 
» Building on the data presented in Sections V and VI, the researchers 


make the following recommendations: 


Recommendation 1. Increase the involvement of the public in every 
level of the educational system. The faculty panel viewed this as an { 
| 
effective method to restore confidence at a time when trust in-schools 


and other institutions is at a low ebb. Beyond this obvious and important 
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value, public involvement should foster the type of interinstitutional 
cooperation that is needed in education. Cremin (1975, p. 7) has argued 
that in the development of education policy 

-.. we must consider the policies with respect to a wide variety of 

institutions that educate, not only schools and colleges, but 

libraries, museums, day care centers, radio and television stations, 
offices, factories, and farms. To be concerned solely with schools, 
in the kind of educational world we are living in today is to have 

a kind of fortress mentality in contending with a very fluid and 

dynamic situation. : 

Involvement of the public should include a comprehensive look at all the 
institutions that educate. 

Recormendation 2. Strengthen the role of the family in the educational 
process. This project identified ten variables that affect educational 
Outcomes. A few of these variables are under the control of the schools; 
many of the more important variables, however, are either under the control 
of fhe family or can be influenced by the family. An eacae home-school 
partnership, therefore, holds strong promise for reversing the forecast 
downward trend of social indicators. This recommendation complements 
Recommendation No. 1 and represents an important first step in increasing 
the involvement of the public in education. Gordon, and his colleagues 
at the Institute for the Development of Human Resources, University of 


Florida, have developed practical approaches to home-school partnership 


* 
and have demonstrated its effectiveness. (Gordon and Breivogel, 1976) 


Recommendation 3. Design the curriculum to incorporate problem solving 
processes for means and values issues. Americans are more effective if 


finding answers to the “how to do it" questions than to the "why we do it -- 
or should we do it" questions. The schools need to provide more assistance 
in helping learners achieve the ability to deal effectively with values 
issues. This recommendation will be elaborated on in the subsequent 


discussion on goals of education. 77 
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Recommendation 4. Allocate resources for education on the basis of 


continuous assessment of both cognitive and noncognitive learning. There 


is a tendency to focus attention on the cognitive skills at the expense of 
the noncognitive skills -- particularly during a period of limited 
resources. For example, music and art programs are dropped from schools 
in order to give support to remedial reading programs. Liberal arts 
education is devalued -- programs are discontinued if they do not lead 

to immediate employment. Public pronouncements infer, some even state, 


that the sole reason for a college education is to secure a better job. 


The above recommendation is nof to deny the value and importance of a 


Practical education and of cognitive skills. Rather, it is to argue for 
i . 


“the reestablishment of a\|teasonable balance of emphasis between the cognitive 


and noncognitive areas. * 
e 


Recommendation 5. S lied work of the most 


knowledgeable scholars in the field of energy. One of the goals of pe 

State of Florida is “the public eeagetien network shall seek solutions to - ° 
local, regional, state and national problems through organized cuidaek 

and development." (Department of Education, 1975, p. 3) One of the most 


XQ 


important state and national problems is energy. The State of Florida has athe 
i] 

some of the most knowledgeable scholars in the field. Policies need to 

be adopted to give these scholars full support -- failure to do'so may > 


\ 
mean that citizens have seriously reduced options regarding energy production 


,and use. 


“ 


A major issue facing the state is how to provide for orderly economic 
growth. Although no recommendation is presented on this issue, education 
has an important role to play. Citizens should have the opportunity to 


» 


help make decisions related to growth. Not only do they need information 
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regarding present and future problems associated with economic growth, 
they also aged an understanding of the historical consequences of 
different economic policies and planning. 

‘ esenmauastans regardin als of education. A reconsideration of 


the goals of education for the State of Florida was not within the scope 


-f thas project. However, through the work of the faculty panel the need 
for a reexamination of the goals became apparent. Social scientists 
writing on the futures of education provide support fo ghis observation. 

- As the faculty panel worked on the task of identifying issues that may 


affect education in the future, they identified a series of symptoms 


within our society including; 


The alienation of various groups in society 
Civil disobedience 
Recurring crises in the financial community 
Loss of faith in leaders and in one's fellowman 
Loss of faith in institutiens -- including government and schools 
\ Loss of faith in rational processes 
The pie of loss of control over one's life 
The \ack of ability of ®eachers to cope with the mix of social classes 
. in urban schools ; 
Poverty’. 


In addition to these symptoms, the panel identified important debates ahead 
over such issues as energy uses and sources, and the right to privacy. 
These considerations lead the panel to identify the following as one of 


the six crucial oa facing education “What is the role of education in 


‘assisting citizens to identify and solve "means" problems and "values" 


problems? Bell indicated the importance of helpagg students deal Pe 


value problems when he wrote 


e 
~ 


++. education today inescapably must confront normativa questions. This 
does not mean the schools have to become propagandists; in. £act, LE 
they become propagandists they become self-defeating. But there are 
societal questions underlying all problems of social management that 
have to be explored. (Bell, 1975, p. 47) 


” 
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Although the questions of values and means generated the original concern 
for reexamining the goals, the need extends beyond this. Accordingly, 


the researchers make the following recommendation: 


Recommendation 6. The goals of education for the State of Florida 
should be reexamined in relation to possible futures. The State Consitiution 
specifies that the state shall provide education “. . .« that the needs of 
the people may require." (Department of Education, 1975) One way to 
ifplement this recommendation would be to examine possible scenarios of 
the future and from this examination deduce the type of education that > 
citizens will require. Two illustrations will be used to show how this : 
might be done. 

Lasswell (1975, p. 2) has predicted that "Global interdependence 
implies that the future of the U.S.A. will- be profoundly conditioned by 
the world environment, and that the future of our neighbors on this planet 
will be deeply affected by our development." Rubin (1975, pp. 27, 28) 
pointed out a series of implications for education based on this and other 


predictions by Lasswell: 


~ students must gain access to social facts; the meaning of these 
facts must be made clear; conceptions of a better world must be 
deepened; and, above all, social awareness must be translated 
into social commitment. 

- children must acquire repeated practice in judging the probable 
consequences of societal events; the skills of decision making 
must be fully exercised; and everything must be done to counteract 
disillusionment and despair. i 

- schooling . . . must endeavor to motivate a lasting interest in 
the common good, a willingness to face hard facts honestly, and 
a higher threshold for civil sacrifice. 


Another illustration is based on the writing of Bell (1975, p. 37) 
who forecast the emergence of a post-industrial society. ". . . that has: 


gore beyond the production of goods, in which the largest sections of the 


~64- 


80 


t 


labor force are primarily engaged in services." Rub#n (1975, p. 55) 


forecast that for this popt-industrial society . me 
... education must become more of an end in itself and less of a 
means to ~.. end. In short, the néw reality with which the schools 
must deal may have less to do with success in the vocational market- 
place and more to do with satisfying interpersonal relationships 
and a meaningful inner life ... Should this be the case, what we 
will most need is a curriculum that speaks to the sources of the « 
good life. 

These illustrations are used to demonstrate the potential value of re- 

examination goals of education in relation to future scenarios as one 

means of assuring that the state provides the education tha the needs of 

‘the people require. 


. ¢ . a . 
It may be argued that ‘the present goals are broad enough to cover all 


the points illustrated in the preceeding -discussion. If so, so 


-reinter- 
pREStAE EON of the goals, or, more precisely, some shifts in emphasis may 


be called for. This can be illustrated by revisiting Recommendation 3: 


* 


Design the curriculum to incorporate problem solving processes for means 
ats ae issues. As indicated in the discussion of this vacuenandation., 
> 
Americans have become very proficient in jaaving with the means problems -- 
the “how-to-do-it" problems -- but are much less effective in dealing with 
value, problems and yet the future of our society will hinge on our ability 


‘ 


"to deal with the latter. , : 
To what extent do the goals of education for Florida deal with values? 
The deal given top priority by the Daparteent of Education is basic skills. 
_ Ndte that basic skills are described as Aeidaiarines, to success. (Department 
of Education, 1975) The basic skills of communication and computation are 
in fact necessary for success -- particularly necessary for success in 
solving the means proKlems. However, they axe not sufficient for solving 


‘ 


the values or "ends" problems. 
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To solve means problems, particularly technological problems, the 


« 


ability to use language and mathematical symbols is all important. ‘To 
“solve values problems requires not only a different type of problem 

solving but it also necessitates different ways of knowing. Values 
problems deal with concepts and emotions associated with truth, compassion,: 
tees hate, RORALAEYs etc.. These a and emotions are in the affective” 
realm and cannot ‘be learned from ia definit\ons. Rather, they ace 
‘leased through eee Through His ages man, has learned an the 
abtective realm through experiences in the arts -- peotry, music, drama, 
dance, drawing, painting, etc. The arts represent on¢ way that children 
can learn the “basic skills“ so important for dealing with the values 
problems ahead. But ‘the present emphasis on a narrow definition of basic 
skills -- to prepare students to deal with means problems -- is driving 


the arts out of our schools. Will future generations be "illiterate" 


in understanding emotions and thus seriously ‘handicapped when they face 


85 > 
value issues? 


Other educative forces have taken dee atgaa BE the school, and to a 
large extent of the home, in providing children with concepts in the 
affective realm. Television is a powerful educational force in influencing 
the ' deve lopment of children’s values. Unfortunately, truth comes to be 
associated with the ond-minute collenabgha comparing the latest washing 
nendet with its nearest competitor -- "It works, it really works!" 
Compassion is siideiated with "being chicken,” love with casual sexual 
encounters, hate with beating and maiming someone because "I didn't like 
his looks" and morality with "what's in it for me." Can society afford to 
, leave the development of "basic skills" in the attective realm to a 


television industry dominated by the Nielson rating? 
4 ; 
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The researchers did nat attemct to reexamine the goals of education es 


« 


e a 
in Florida. The preceeding/discussion is presented to suggest the desira- 


bility of conducting such’a reexamination. 


for education. This 
project 3 demonstrated some possible uses of an exploration of the future 


- 


as a component in a planning process for education. The researchers, with 


« 


the assistance of the faculty panel and building on the experience of the 


1 ca 
past vear, considered various ways in which studies of the future could 


r 
‘ 


contribute to the planning process. AS a result the following recommendation 


am % P om 
is made. 


Recommendation 7. A systematic examination of the future: should continue 
to be a basic part of the process for planning in education in Florida. 

The fusalan of thid project is evidence that personnel in the Strategy 
Planning and Management Information, System Section at the Department of 
baucekton are interested in considering the future in their planning process. 
The intent at this recommendation is to support this interest and to suggest 
specific ways in which the future may be uSed in planning for education. 

The faculty panel assisted the researchers in developing the following 
method for utilizing forecasts in.identifying future problems and proposing 
Seiubbene: clarify goals; describe past trends; analyze causal conditions; 
project future developments; invent, evaluate and select policy alternatives. 
This mathe is based on a list of procedures developed by Lasswell (1975, 

p. 1) which will be briefly described below. ‘ : 

a Clarify goals. The Presiderit of the United States in 2020 is 

probably in an elementary school today. Are the educational”. ~ 
agencies preparing this person for their important role? Are 
ail ideas in today's schools being prepared to cope with the many 


issues they will be called upon to resolve? It,is, of course, 
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impossible to anticipate all of the problems that will be faced. 


However, through studying the writings of various futurists it 


would be possible to prepare summaries that could be used as one 


. 


basis for periodic reexamination and clarificatign of the goals 


of education. 
Describe past trends. An understanding of past trends can be used 
in forecasting future events. If time series data regarding 
educational outcomes can be accumulated, it would be possible to 


extrapolate future trends. This information could serve'.as a 


' « 
guide in modifying goals of education and methods used in achieving 


‘ 


them. ~ 


Analyze causal conditions. An examination of pase hands should be 

accompanied by an analysis of the conditions that caused these . €: 
trends. At bis ane sites projection of future trends and evarte 
should aid the educational planner in anticipating future barriers 
to effective education and developing strategies to Siatecinn them. 
Such ,a projection could lead to research ‘phates that” would extend 
knowledge on causal serdivions. The summary of the literature’ 
search presented in Section. IV of this report provides a good 
baseline for further analysis of: cavsal conditions. , 

Project future developments. The projection of future developments 


is central to many of the other steps in the method recommended. 


A summary of future developments would be of value in clarifying 


Pi . 


- 4 a . 
goals. Similarly, such a summary would be important in projecting 


past trends into the future, in analyzing causal conditions and 


in recommending policy decisions. The importance of the step of 
4 


projecting future developments demonstrates the interactive nature 


of the five procedures. : . « 
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5. Invent, evaluate <Any weet policy ‘sencuuetoet. As a result .s 
the four procedures outlined above, it would be possible. to 
invent, evaluate, and select policy procedures. The evaluation + 

hyants be of two types. First, through a simulation or a pilot 
study it would be possible to*estimate the consequences of an 
‘4 alternative. Second, once the policy alternative has been insti- 
tuted, its impact would be monitored. 
A verv snpostent Sonne ranian in the use of the five procedures 
outlined above is who should participate in the various activities. 

_ Since decision’ resulting from these ‘activities will be among the most 

important for dur society, the question of participation needs to be 

addressed by considering the following:questions: 


1. Given the right of people to decide their own destiny, 
in what ways should the public be involved? 


2. Given that implementation of a policy requires involve- 
ment in decision making, in what ways should professional 
educators be involved? ‘ . 


~ 


3. Given that specialized technical capabilities are required 
for generating some types of data, what are the roles 
for the specialist? 


These questions should not be answered in isolati “_P fact, the most 
effective planning for the future will result ie iva eantinabed effort 
of the public, the professional and the researcher. The researchers e 
who had the opportunity to sock on this project hope that the data 


generated, as well as the procedures developed, will contribute to such 


coordinated planning for education. 


’ =69- 


( Bibliography 
ieee 
Armor, D.J. School and family effects on black and white achisyament: a 
reexamination of the USOE data." In F, Mosteller and D.P. Moynihan ° 


(Eds.), On Fmuality of Educational Opportunity. New York: “Random 
House, 1974, 168-229, 


Associated Press release in Gainesville Sun, ‘February 12, 1976. - » 


“Averch, H.A, et al. How Effective is Schooling? A Critical Review and 


Synthesis of Research Findings. Santa Monica, California: Rand 
Corporation, 1972, ” - 


Bell, D. "Schools in a communal society." In L, Rubin (Ed.) The Future of 
Education; Perspectives on tomorrow's schooling. Boston: Allyn and 
“Bacon, Inc,, 1975, 31-48. 


Boocock, S.S, "Toward a sociology of learning: a selective review of 
existing research." Sociology of Education, 1966, 39, 1-45. 
aa eee oo 


Coleman, J.S. et al. Equhlity of Educational Opportunity, Washington, D.C.: 
U.S. Department of Health, Education and Welfare, U.S. Government 


rinting Office, 1966. 


azo, A., Lewis, A, and Thomas, Ww. Social Indicators for Assessing 


Educational Achievement of Florida Citizens (Technical Report No. 2 
to the Department of Education Project on Social Indicators). 
/ University of Florida, December 19, 1975, 


Collazo, A., Lewis, A. and Thomas, W. Components of a Medel for Forecast- 


ing Future Status of Selected Social Indicators. (Technical Report 
No, 3 to the Department of Education Project on Social Indicators), 


University of Florida, March 26, 1976, 


- Cremin, L.A, "Public Education and the Education of the Public.” Teachers 
College Record, 1975, 77, 1-12. 4 


Cronbach, L.J. Essentials of Psychological Testing. New York: Harper 
and Row Publishers, 1970. 


Dalkey, D. "An Elementary Cross-Impact Model." Technological Forecasting 
and Social Change, we: 3. ° 


Department of Education. Education Policy for the State of Florida, Florida; 
; Department of Education, March, 1975.- 


. 


Dusek, J.B. and Connell, E.J. ‘Teacher expectancy effects on the achieve- 
ment test performance of elementary school children.” Journal of 


Educational Psychology, 1973, 65, 371-377, 


a 


Entwistle, N.J. "Personality and academic attainment.” British Journal of 
Educational Psychology, 1972, 42, 137-151, 


-70- 


. 86 ¥ fi 


- 
. 


( ’ 
Gaite, A.J.H. "Teachers' expectations: an influence on pupil performance.’ 
Instrpctor, O', 1974, 84, 38, 


. ‘ 
Gjeame, T. "Sex differences in the connection between need for achievement ~- 
and school performance.” , Journal of Applied Psychology, 1973, 58, 

270-272, e 


- 


Gordon, I. and Breivogel W. (Eda)Building Effective Home - School Relnpsor 
ships. Boston: Allyn and Bacon,Inc,, 1976, 


‘Holt, J. How Children Learn. New York: Pitman Publishing lala 1967. 


Holt, J. What Do I Do on Monday? tiew York: E.P, Dutton and Co., 1970. 


Illich, I, Deschooling Society. New York: Harper and Row, 1971, 


. 


Jencks, C.S, "The guality of the data collected by the Equality of Education- 
al Opportunity syfvey." In F. Mosteller and D.P, Moynihan (Eds.), 
On Equalit ducational Opportunity. New York: Random cai il 


437-512. 


Jensen, A.R, “How much can we boost 1.Q. and scholastic achievement?” 
Harvard Educational Review, 1969, 39.' 


Johnson, 5.5. Update on Education: A digest of the National Assessment 
te ar a a le a lt eit ead 
ak ol Educational Progress, Denver, Colorado: NAEP, 1975. 


Joseph, C.C. "An introduction to studying in the future." In-S. Hencley 
aud J, Yates (Eds.) Futurjsm in Education: Methodologies. Berkeley, 
California: McCutchen Publishing Corporation, 1974, 9-10. 


Kane, J. "A primer for a new cross-impact language KSIM."" Technological 


Forecasting and Sovial Change, 1972, 4. 
= RCS rast ee ees Le Bie A os {/ 
Khan, S.B, " 


Sex differences in predictability of academic achievement." 
Measurement and Evaluation in Guidance, 1976, 6, 88-92. 
4 
Klinger, E. ‘Fantasy need achievement as a motivational construct.” 
Psychological Bulletin, 1966, 66, 291-308. E 


Lasswe]l, H.D. "The future of government and politics in the United 
States,” In L. Rubin (Ed.) The Future of Education: Perspectives 
on tomorrow's schooling, . Boston: Allyn and Bacon, Inc., 1975, 1-21. 


Lyle, J.&. "Research on achievement determinants in educational systems; 
a survey.” Socio-Economic Planning Sciences, 1967, 1, 143-155. 


Mayeske, G.W. et al. A Study of Our Nation's Schools. Washington, D.C, 
U.S. Department of Health, Education and Welfare, U.S. fovernsent 
Printing Office, 1972. \ 


> 


os 
Mayeske, G.W. et al, A Study of the Achievement of Our Nation's Students. 
Washington, D.C.: U.S. Department of Health, Education and Welfare, 
U.S. Government Printing Office, 1973, 


=71= 


87 


Mayeske, G.W. and Beaton, A.E. Special Studies of Our Nation's Students, 
Washington, D.C.: U.S. Department of Health, Education and Welfare, ‘ 
U.S, Government Printing Office, 1975, 


McClelland, D.C, et al. The Achievement Motive. New York: Appleton 
Century Crofts, 1953. 


. 


McDill, E.L. et al. "Institutional effects on the acadesttc behavior of 


high school students.” Sociology of Education, 1967, 40, 181-199, 


New York Times, June 9, 1976. 
Plessas, D.J. and Rieca, F. "An evaluation of sopial indicators” AIp/ 
Journal, January 1972, 43-51, \ De 


Pollard, D.S, "Educational achievement and ethnic group membership." 
Comparative Education Review, 1973, 17, 362-374. 


Purkey, W.W. Self Concept and School Achievement. Eng lewood Cliffs, New 
Jersey: Prentice Hall, Inc., 1970. 


is ¢ 
Rosenthal, R. and Jacobson, L.F,. "Teacher expectations for, the disadvant- 
’ aged." Scientific American, 1968, 218, 19-23. 


Rubin, L. (Ed.) The Future of Education: Pergpectives dn tomorrow's 
schooling.. Boston: Allyn and Bacon, Incl, 1975. 


LD 


: ‘$ 
Silberman, C.E. Crisis in the Classroom. New York: Randon House, 1970. 


Simons, R.H. and Bibb, J.J.’ "Achievement motivation, test anxiety and 
underachievement in the elementary school"’ The Journal of Educational 
Research, 1974, 67, 366-369. 

‘| . * 

Smith, M.S, "Equality of Educational Opportunity: the basic findings 
reconsidered.” In F. Mosteller and D.P. Moynihan (Eds.), On Equality 
of Educatifonal Opportunity. New York: Random House, 1972, 230-342. 


Soar, R.S. "Teacher-pupil interaction." In J.R. Squire (Ed.) A New Look 
at Progressive Education, Washington, D.C.: Association for Super- 
vision and Curriculum Development Yearbook Committee, 1972, 166-204. 


Soar, R.S, and Soar, R.M. Selected Recent Research, Mimeograph, 1975. 
Summers, A.A. and Wolfe, B.L. Which School Resources Help Learning? 


Efficiency and Equity in Philadelphia Public Schools. Philadelphia, 
PA: Federal Reserve Bank of Philadelphia, 1975. 3 


Appendix A, 


Selection of Variables Through 
Modified Q-Sort Techniqiygy 


The modified Q-sort technique used the instrument reproduced below. 

The number in each cell represents the number of choices made. The weight~ 

ed total was computed by weighting tallies in each column using a factor 

equal to the reciprocal of the probability that any item would be checked 

in given column,: Since ten items were selected out of fourteen possibili- 

ties in column 1, the probability of ‘the selection of any one item is 

10 out of, 14. The reciprocal weighting factor is, therefore, 14/10 or 

1.4. Similar weighting f&ctors were computed for columns 2, 3 and 4 to 

be 2433, 4.67 and 14. The weighted total is a summation across the row. 

Possible Variables ‘put’ of 14] Out of 10] Out of 6] Out of _3| Weigh- 

elect 10] Select 6} Select 3) Select 1} ted 

Most Imp.| Most Imp.| Most Imp.| Most Imp.| Total 
Variable Variable Variab?Pe Variable 


Family expectations, atti- 
tudes & aspirations 


-_ 
~ 
oO 


-_ 
~ 


i] 
~ 
o 


Peer-group characteristics 


~ 
~] 
uo 


Socio-economic status 


~- 
~ 
@ 


Student's general ability 


] 
wo 


Student's self concepts 
Student's aftitude and 
motivation 


@ 
° 


Student's fate control 
Teacher expectations 


~ 
°o 


ae - 
© -_ w 


Teacher experience 
Teacher. behavior in 
classroom 

Teacher training 

Teacher academic standards 


Normative system of the 
school 


~ 
f=) 
a 
i ~ 
> 
_ 


~ 
oO 


28 


Administrative leadership 48 


a 
np 
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1. 


2. 


11, 
12, 
13. 


14. 


15. 
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Appendix B 
¢ 


Selection of Issues Affecting Education 


. Select ll Select t Select e Select 1 

. Most Imp. a 
What provisions should be made for SHCUC SIRE youth 
into the world of work? 
How can Florida provide for orderly économic growth? 
How can the state restore confidence at a time when 
trust in schools and other institutions is at 
a low ebb? 
What is the school's role in solving social problé 
q ould each community have a board of community 

ducation responsible for setting goals, coordinat- 
ing programs and allocating resources? 
How shall we meet the challenges of an aging 
population in Florida? 
If current economic trends continue, how can schools 
maintain current standards with less money? 
Should the number of years of compulsory schooling 
be reduced? Should compulsory education be 
abolished altogether? 
Should legislative decisions attempt, to reverse the 
trend of a growing disparit between. social classes? 
Should state resources be used to support all educa- 
tive agencies, not just public schools, colleges, 
and universities? = 
What is the state's responsibility for providing 
educatiqnal opportunities for all citizens and 
at all levels? 
What is the role of the schools in the socializa- 
tion of youth? 
How should Florida, supply industry's labor needs? 
What is the role of education in assisting citizens 
to identify and solve "means" problems and "values". 
problems? : 
How can Florida meet its needs for energy and 
natural resources? ; 


3 

) 

~v 
-_ 
[=] 


~ 
~ 


~ 
°o 


Scores 


62 
42 


41 


17 


42 


72 


48 


: ' Out of 15] Out of 11] Out of 7] Out of 3| Weighted 
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